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Abstract 

The  identification  of  a  linear  discrete-time  control  system’s  loop  gain  is  addressed.  The 
classical  Kalman  filter  theory  for  state  estimation  in  linear  control  systems  is  extended,  and  the 
control  system’s  loop  gain  and  state  are  jointly  estimated.  A  rigorous  analysis  of  the  measurement 
situation  under  consideration  yields  explicit  formulae  for  the  loop  gain’s  unbiased  estimate  and 
estimation  error’s  covariance. 
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Chapter  1  -  Introduction 

1.1  Background 

Feedback,  and  the  reliance  on  high  gain  action,  are  used  to  mitigate  the  ill  effects  of  the  un¬ 
structured  environment  where  the  controlled  plant  is  operating.  At  the  same  time,  the  benefits  of 
feedback  control,  and,  in  particular,  high  gain  action,  are  severely  circumscribed  by  sensor  noise 
[10].  System  identification  entails  the  estimation  of  a  control  system’s  parameters  from  measure¬ 
ments  on  the  system’s  inputs  and  outputs  [11];  as  such,  system  identification  lends  itself  well  to 
integration  into  modem  feedback  control  synthesis,  because  no  additional  hardware,  i.e.,  sensor  or 
actuators,  above  and  beyond  the  components  used  in  conventional  feedback  control,  are  required. 
The  incorporation  of  system  identification  into  feedback  control  law  synthesis  calls  for  additional 
signal  processing,  however,  a  reduction  in  plant  uncertainty  is  achieved.  Therefore,  lower  gains 
in  the  feedback  control  law  are  possible.  Hence,  there  is  a  strong  incentive  for  the  incorporation 
of  system  identification  into  control  law  synthesis  and  the  employment  of  indirect  adaptive  control. 
Unfortunately,  system  identification,  which  entails  the  estimation  of  all  the  plant’s  parameters,  re¬ 
sides  in  the  realm  of  nonlinear  filtering.  It  is  however  recognized  that  accurate  information  on  the 
control  matrix  parameters  is  of  paramount  importance  in  control  law  design,  e.g.,  in  flight  control 
one  then  refers  to  the  “control  derivatives”.  Now,  in  linear  control  systems,  and  provided  that  the 
dynamics  matrix  is  known,  the  exclusive  estimation  of  the  parameters  of  the  control  matrix  only 
is  reducible  to  a  problem  in  linear  regression  and  therefore,  is  amenable  to  analysis  using  linear 
mathematics.  Hence,  a  rigorous,  i.e.,  an  unbiased,  estimate  of  the  parameters  of  the  control  matrix 
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can  be  obtained.  In  this  thesis,  a  simplified  version  of  this  problem  is  addressed  and  an  algorithm 
for  the  estimation  of  a  single  input  control  system’s  critical  loop  gain  parameter  is  developed.  The 
inclusion  of  a  “forgetting  factor”  into  this  basic  algorithm,  or  the  employment  of  a  sliding  window, 
will  afford  on-line  operation.  Thus,  a  possible  mechanization  of  an  indirect  adaptive  flight  control 
system  which  incorporates  the  loop  gain  identification  algorithm  developed  in  this  paper  is  illus¬ 
trated  in  Fig  1.  In  a  flight  control  application,  the  states  a.  and  q  represent  the  aircraft’s  angle  of 


attack  and  pitch  rate,  respectively. 

1.2  Problem  Statement 

The  linear  discrete-time  control  system  is  considered, 

Xk+i  =  Axk  +  Kbuk  +  rwk,  k  =  0,1,...,N -1,  E{wkwl)  =  Q  (1) 

Xo  =  N{Xo,Pox)  (2) 

K  =  N{Ko,Po^)  (3) 

Vk+l  ~  (^) 

Zk+1  =  Vk+i+Vk+i,  E{vk+ivl+i)  =  R  (5) 

In  the  special  case  of  a  single  scalar  output,  the  measurement  equation  (5)  is 

Zk+i  =  Vk+i  +  Vk+i,  Vk+i  =  N{0,  cr^)  (6) 


The  control  system’s  state  Xk  G  5R”.  The  dynamics  matrix  A,  the  control  matrix  b,  the  obser¬ 
vation  matrix  C  and  the  vector  T  are  known.  The  respective  process  and  sensor  noise  covarinaces, 
Q  and  R  (or  a)  are  also  known.  In  addition,  the  prior  information  specified  in  Eqs.  (2)  and  (3)  is 
provided.  It  is  required  to  identify  the  scalar  loop  gain  K,  given  the  input  sequence  uq,  wat-i 
and  the  measurements  record  zi,Z2,.-.-,zn.  An  estimate  of  the  control  system’s  state  is  also  ob¬ 
tained.  Here,  the  loop  gain  parameter  K  is  developed.  Hence,  for  instance,  in  the  flight  control 
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application,  one  can  now  handle  control  surface  failure.  Obviously,  for  an  unfailed  plant  (aircraft) 
the  loop  gain  K  =  1  (by  definition),  viz.,  K  is  unity,  until  a  failure  at  time  t f  reduces  the  control 
derivative  and  forces  K  <1. 

In  this  research,  the  identification  of  the  control  system’s  loop  gain  K  is  undertaken.  The 
classical  Kalman  filter  theory  for  linear  control  systems  [3]  is  extended  and  the  control  system’s 
state  and  loop  gain  are  jointly  estimated.  Explicit  formulae  for  the  loop  gain’s  (unbiased)  estimate 
and  estimation  error  covariance  are  derived.  The  state  estimate  and  the  covariance  of  the  state 
estimation  error  are  also  obtained.  Also,  digital  control  and  digital  signal  processing  are  employed. 
Thus,  a  sampling  rate  of  lOOHz  is  used  and  in  our  simulation  the  continuous-time  plant  dynamics 
are  discretized  accordingly. 

1.3  Proposed  Adaptive  Plant  Controller 


Process  Noise  w 


Figure  1.  Flight  Control  System 

The  propsed  adaptive  controller  is  shown  in  Fig.  1 .  A  pilot  commands  a  pitch  rate  signal,  qc, 
into  the  adaptive  controller.  The  commanded  input  is  passed  through  a  low  pass  filter  and  into  a 
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PI  or  proportional  fixed  controller  to  imporve  tracking  performance  creating  the  signal,  r.  Inside 
the  boxed-ofF  section  labeled  ‘adaptive  controller’  is  the  system  identification  algorithm.  The 
identification  algorithm,  i.e.,  modified  Kalman  filter,  is  fed  noise  corrupted  measurements,  am  and 
q^,  from  the  plant.  In  turn,  (filtered)  estimates  of  a,  q  and  loop  gain  K,  a,  q  and  K  respectively, 
are  calculated  for  each  time  sample.  The  estimates  a  and  q  are  then  fed  back  and  summed  with 
the  signal  r.  The  reciprocal  of  K  is  fed  back  into  the  foward  path  after  the  summing  junction  of 
the  states  and  signal  r  but  before  the  actuator.  The  actuator  being  used  in  this  research  is  for  the 
elevator  of  an  F-16  class  aircraft.  By  feeding  back  i,  the  effects  of  K  in  Eq.  1  will  be  reduced 
and  tracking  performance  restored.  The  value  of  K  corresponds  to  a  degree  of  failure  in  the  flight 
control  system. 

1.4  Assumptions 

Chapter  2  describes  the  classical  system  ID  procedure  for  finding  a  system  model.  For  this 
thesis,  the  system  order  and  plant  is  assumed  to  be  known  before  hand.  The  research  proceeds  under 
the  assumption  that  the  failure  in  the  elevator  does  not  significantly  change  the  over-all  aircraft 
system  model.  For  this  reason,  the  identification  of  the  aircraft  model  is  not  needed  and  the  focus 
is  spent  of  identifying  the  open-loop  gain  which  corresponds  to  the  degree  of  failure. 

In  this  thesis,  only  the  short  period  approximation  is  used  and  the  phugoid  period  is  neglected. 
This  is  done  because  the  phugoid  oscillation  occurs  in  under  thirty  seconds  where  as  the  short 
period  ocsillation  occurs  in  under  one  second.  Since  the  research  being  presented  in  this  thesis 
deals  with  failing  control  surfaces,  the  time  needed  to  detect  a  failure  must  occur  in  a  short  period 
of  time.  This  is  to  prevent  aircraft  uncontrolability  and  loss. 

When  dealing  with  the  short  period  approximation  of  an  F-16  class  aircraft,  both  the  alpha 
and  q  channels  are  used  in  the  feedback  design  -  see  Fig.  2  for  a  visual  description  of  alpha. 
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Figure  2.  Aircraft  longitudinal  parameters 
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Although  pitch  rate  tracking  can  be  done  without  use  of  the  alpha  channel.  Figs.  3-6,  the  extra  data 
it  provides  is  beneficial  to  the  Kalman  filter  used  in  the  system  identification  algorithm.  It  also 
provides  additional  tracking  stability  when  there  is  a  control  surface  failure  in  the  longitudinal  axis. 

Pitch  Rate  Response  to  a  Step  Input  With  Kr 


Figure  3.  Pitch  rate  response  without  using  alpha  feedback  with  gain  Kr 

Figs,  (7)  and  (8)  show  that  a  change  in  the  measurement  noise  in  the  a  channel  has  minimal 
effect  on  the  controllers  ability  to  track  a  (the  dashed  verticle  line  indicates  the  time  of  failure, 
t  =  3  sec.).  However,  it  does  influence  the  pitch  rate  measurements  -see  Figs  (9)  and  (10).  This  is 
because  the  two  channels  are  coupled.  For  this  reason,  the  square  root  of  the  strength  of  the  alpha 
noise  is  held  constant  at  0.03  degrees.  This  way  the  effects  of  measurement  noise  on  the  controllers’ 
ability  to  track  the  pitch  rate  can  be  analyzed  and  compared.  It  also  provides  some  dynamics  for 
the  system  identification  algorithm  and  creates  a  more  realistic  measurement  case.  Implementing 
a  PI  or  proprotional  controller  to  improve  tracking  performance  yielded  similar  results.  This  is  due 
to  the  robustness  of  the  original  flight  control  system. 
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Kq  =  1.046000e+000 
Kd  =  2.000000e-001 

■  « _ I - 1 - 
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Figure  5.  Pitch  rate  response  without  alpha  feedback  using  a  PI  controller 
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Figure  10.  Pitch  rate  response  with  a  fixed  controller;  aa  =  0.3  deg/sec,  K=0.8,  SNR=1 8.61  dB 


The  noise  vector  used  in  this  thesis  was  created  using  the  Matlab^  RANDN(N)  function  [12]. 

This  command  picks  data  points  from  a  normal  distribution  with  mean  zero  and  variance  equal  to 

one.  After  every  run  of  the  simulation  code,  the  noise  generator  is  reset  to  a  initial  point  inside 
(R) 

Matlab^.  This  created  a  fixed  single  noise  sample  for  all  simulations.  A  better  method  would 
have  been  to  set  up  a  Monte  Carlo  run,  generating  hundreds  of  noise  vectors  and  averaging  them  to 
get  more  random  noise  input.  However,  running  a  Monte  Carlo  analysis  is  time  consuming  and  is 
not  a  necessary  focus  for  this  thesis. 

Process  noise  is  represented  in  the  system  identification  algorithm  as  tu, however,  no  process 
noise  is  implemented  in  the  simulation  runs.  This  is  done  to  show  that  the  estimation  techniques 
described  in  this  thesis  work  in  a  deterministic  case.  The  only  noise  used  in  the  simulations  are  the 
alpha  and  pitch  rate  channel  measurement  noise  needed  for  the  algorithm. 

1.5  Organization  of  Thesis 

Chapter  1  provided  an  overview  of  the  problem  statement,  a  description  of  the  proposed  plant 
and  the  assumptions  and  reasoning  for  various  parts  of  the  research.  Chapter  2  gives  the  classical 
approach  to  system  identification,  an  example  of  a  second  order  system  and  a  stochastic  approach 
when  noise  is  introduced  into  the  system.  Chapter  3  introduces  the  deterministic  approach  to  the 
system  ID  algorithm  used  in  the  thesis.  The  stochastic  approach  to  the  algorithm  presented  in 
Chapter  4  will  be  the  main  system  identification  algorithm.  Chapter  4  also  provides  examples 
and  remarks  concerning  the  development  of  the  open-loop  gain  system  identification  algorithm.  A 
numerical  simulation  experiment  is  performed.  Thus,  a  flight  control  experiment  is  performed  and 
numerical  simulation  results  which  corroborate  the  developed  theory  are  presented  Chapter  5.  The 
effects  of  sensor  noise  on  identification  performance  are  also  investigated  and  presented  in  Chapter 
5.  Concluding  remarks  are  made  is  Chapter  6. 
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Chapter  2  -  System  Identification 


2.1  Introduction 

This  chapter  provides  general  background  knowledge  of  system  identification  techniques. 
Both  the  classical  and  stochastic  analysis  methods  are  explained  and  examples  are  given.  Also, 
some  concerns  and  design  considerations  related  to  system  identification  are  addressed. 

When  modeling  a  system,  there  are  two  approaches  of  consideration,  deductive  and  empirical 
[17].  With  deductive  modeling,  the  laws  and  equations  found  in  physics  and  engineering  are  used 
to  predict  the  proper  model.  With  the  empirical  (system  identification)  approach,  least  squares  and 
Kalman  estimates  are  found  to  form  a  statistical  approach  for  determining  a  dynamics  of  the  system. 

System  identification  has  more  applications  than  just  for  modeling  purposes.  It  is  also  a 
useful  technique  for  model  order  reduction  of  a  plant  or  compensator,  for  measuring  or  estimating 
parameters  and  for  real  time  adaptive  control. 

One  of  the  challenges  that  needs  to  be  addressed  is  modeling  error,  especially  when  the  order 
of  the  system,  n,  is  not  known.  This  error  may  consist  of  various  disturbances  such  as  process 
and  measurement  noises.  Over-modeling  is  another  source  of  error  in  system  identification.  It 
may  seem  logical  to  over-model  a  system.  The  extra  parameters  would  be  redundant  and  make 
determining  the  over-all  system  model  easier.  When  determining  the  unknown  parameters  of  a 
higher  order  model,  the  parameters  that  exceed  the  order  of  the  physical  system  should  equal  zero 
and  fall  out  of  the  equation.  However,  this  does  not  always  happen  because  of  rounding,  noise 
and  other  anomalies  being  injected  into  the  calculations.  These  approximated  values  disturb  the 
pole  and  zero  placements  of  the  system.  Therefore,  it  is  better  to  under-estimate  the  order  of  the 
unknown  system  than  to  over-estimate  it.  Under-modeling  requires  determining  values  for  the 
parameters,  aj,  a2,-  •  • ,  bi,  b2,-  •  • ,  that  yield  the  best  fit  over  a  desired  bandwidth. 
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2.2  Classical  System  Identification 

Consider  the  continuous-time  transfer  function  (TF)  [17] 

H(s)  =  =  hiS”'  ^-F62S^~^-| - +bn-lS  +  bn 

u{s)  s”  -  ais’^-1  -  02s”-2 - a„_is-a^ 


If  we  chose  the  input  to  be 


The  output  is  the  phasor 


Uk{t)  =  sincjfct,  0  <  t 


yk{t)  =  {Ak+jBk)smujkt 

=  \/^k  +  Blsm{wkt  +  (f)) 

=  A  sin(cufci  + 


(f>  =  A  tan  ( ^ 


where 


Letting  s  =  juj  and  substituting  into  H(s) 

_  bi{jajk)^  ^  +  b2{j<^kY~‘^  - 1~  bn-ijjoJk)  +  bn 

{j<^kY  -  0'l{3^kY~^  -  a2{jUkY-^ - an-lijoJk)  -dn  ^  ^ 

Cross  multiplying  and  reducing  creates  a  linear  equation  where  the  coefficients  a  and  b  can  be 


obtained. 


n 

Ak+jBk  =  '^{Ak  +  3Bk){juk)~''ai  +  '^{jukY’^bj 


Expanding  the  equation  gives 


Ak+jBk  =  -:{Ak+jBk){ — ai - 3  as  +  ~~  - ) 

3  ^k  cvl  U>1  ul 

+t( — hi - 3  63  -F  ^hs - - ) 

3  iVk  u:l  a;|  u^l 

+{-^k+  3Bk){ - 02  +  ^04 - ^06  -I - ) 

o’fc2  a>i  u)° 

+(-——62  -t-  — jh4 - g  he  -I - ) 

cor  Lol 
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Multiplying  both  sides  by  j  and  expanding,  we  are  able  to  match  the  real  and  complex  portions  of 
the  right  side  of  the  equation  with  the  left.  This  will  allow  us  to  solve  for  the  unknown  coefficients. 


^  /  1  1  1  1  7  X 

—Bk  —  Af;[ - ai - 3®3  H - 5®5 - 7^1  +■••) 

UJk  U},, 

r,  /  1  1  1  ^ 

+Bk{ — 02 - 4  04  H — gOe  —  •••) 


+( — bi - 3 63  H — 365 - +  ■  •  • ) 

Wfc  ul  ul  ul 


Ak 


Bk  (  0-1  3  03  T  3  05  y  o  “{“*’■) 


Wfc 


CO' 


"'k  '■^k 

.  /  1  1  1  ^ 

+Ak{ - 02  H — TO4 - g  og  +  •  •  • ) 

C0fc2  Lol  LOl 

/  1  L  1  L  1  ^ 

+( - ^2  H - 4^’4 - g^6  H - ) 


cot 


C0fc2 


COT 


COY 


(14) 


For  an  n*^  order  SISO  system,  the  control  system  is  specified  by  2n  parameters.  For  this  reason, 
we  chose  n  sinusoidal  test  functions,  each  one  producing  2n  equations. 


2.2.1  Second  Order  Example 

Given  the  TF  [17] 

s^  +  2Culs  +  ivl 

Knowing  that  we  can  measure  the  output  phasor,  the  unknown  parameters,  6  and  ujn,  can  be  solved 
using  the  technique  described  in  Eqs.  (1 1)“(14): 

A  +  jB  =  - o . - T 

+  2(^UJnJiO  +  U)^ 

Cross  multiplying  and  simplifying  yields 

(^4  +  jB)(co^  -  co^  +  2Cco„jco)  =  co^ 


{A  —  l)ci;^  —  2Sa;((^a;„)  —  Auj^  +  j  {B(jj\  +  2Au}((u))  —  BuP')  =  0 
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Separating  the  complex  and  real  terms 

{A  —  1)0;^  —  2Bu!{(^u;n)  =  AuP' 

B(jj^  +  2A(jj{(^ijS)  =  BuP' 

Solving  for  natural  frequency  and  damping  ratio,  the  unknown  parameters,  yields 

U) 

^ - 

Recall,  A  and  B  are  the  coefficients  of  the  output  phasor  and  can  be  directly  measured. 

2.3  Stochastic  Analysis 

A  goal  of  system  identification  is  to  find  a  “best  fit”  model  of  the  system  being  analyzed  [15]. 
The  stochastic  analysis  takes  the  measurable  input  and  output  data,  which  has  some  noise  influ¬ 
ence.  Using  a  least-squares  approach,  the  sum  of  the  squared  errors  between  the  true  output  of 
the  model  and  the  measured  output  is  minimized.  Using  the  least-squares  approach  and  stochastic 
estimation,  large  errors  and  poor  measurements  are  given  less  value  or  priority  than  more  accurate 
measurements.  Because  of  the  introduction  of  noise  into  the  system  and  consequently  the  imple¬ 
mentation  of  stochastic  analysis,  our  once  continuous  system  is  now  discretized  and  represented  as 
a  discrete-time  model. 

In  a  case  of  a  dynamic  system,  a  system  output  can  be  described  as  [7, 15, 17] 

Z/fc+l  ~  ^iVk  d”  ^2yk—l  d“  ■  ■  ■  “1“  OinUk—n+X  d“  ^I'^k  d"  1  d”  ‘  ‘  ‘  d”  (15) 

and  the  measurement  equation  as 

Zk+i  =  yjfc+i  d-  t’fc+i,  Vk+i  =  77(0,0-^)  (16) 


^(A2  +  B2  -A)(A2  +  J52) 
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which  may  contain  process  and  disturbance  noise.  Manipulating  the  above  equation  a  little  we  can 


say 


VkJrl  =  —  'Wfc+l 

Vk  =  Zk-  Vk 


Therefore, 

Zk-\-l  —  Kfe+l  =  01(2;*:  “  Vk)  +  a2{Zk-\-\  —  Vk-l)  H - h  an{Zk-n+l  —  Vk-n+l) 


+biUk  +  b2Uk-\  +  •  •  •  +  bmUk-m+l  (17) 

By  defining  a  noise  vector,  Yfe+i,  we  can  rearrange  the  above  equation 

Zk+l  =  CblZk  +  a2Zk-l  +  •  •  •  +  anZk-n+l  +  blUk  +  b2Uk-\  H - +  bmUk-m+\ 


+14+1 


where 


—  Vk-\-l  0,lVk  Cl2Vk—l  +  •  •  •  0,nVk—n-\-l 


(18) 


Now,  the  measurement  equation  is  defined  as 


Z = HQ +V 


(19) 


where 


/  Zk+l  \ 

Zk+2 


and 


\  ^k+N+l  /  (;v+l)xl 

/  Zk  Zk-1 

Zk+l  Zk 


(a,  X 


e 


bx 


V 


\bm  J 


(m+n)  xl 


^k—n'\-l  '^k  "^k—l 

^k—n-\-2  '^/c+1  '^k 


I  \ 

Vt+2 


\  t4+jv+i  /  (iv+i)xi 


Vk—m+l  \ 
V‘k—m+2 


(20) 


\Zk+N  Zk+N-\  •••  Zk+N-n+1  Uk+N  Uk+N-1  ■■■  Uk-m+N  /  (N+l)x{m+n) 

In  this  notation,  m  is  the  number  of  measurements  and  n  is  the  number  of  parameters  to  be  identi¬ 


fied.  We  can  now  find  the  Least  Squares  estimate,  ©,  and  the  error  covariance  matrix  P  [1, 17]. 
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The  Least  Squares  estimate  is  defined  as 

0  =  (22) 
The  above  equation  calculates  the  parameter  estimates  using  an  unweighted  pseudo-inverse.  This 
is  possible  when  the  weighting  matrix,  R,  is  assumed  to  be  diagonal  or  when  cross  correlation  does 
not  exist.  When  this  assumption  is  made,  R  =  cr^/,  where  I  is  the  identity  matrix  and  the 
strength  of  the  noise,  drops  out  of  the  equation. 

The  error  covariance  is  defined  as 

P  =  (23) 

It  too  does  not  take  into  effect  the  measurement  or  process  noise  when  estimating  the  parameters. 
A  more  rigorous  method  would  be  to  solve  for  the  parameter  estimates  and  error  using  a  weighted 
pseudo-inverse  to  account  for  any  noise  in  the  system.  The  minimum-variance  estimate  is  defined 
as  [3,4] 

@Mv  =  {H^R-^H)-'^H'^R-^Z  (24) 

and  the  minimum-error-estimate  is 

Pmv  =  a^{H^R-^H)-'^  (25) 

2.4  Calculating  R 

R  is  affected  by  the  noise  created  by  our  sensors  when  measuring  the  output  of  the  system. 
Many  times,  R  is  represented  as  a  diagonal  matrix  with  cr^  along  the  diagonal  and  zeros  in  the  oflf- 
diagonal  spaces  which  represents  no  cross  correlation.  This  seems  true  knowing  each  output  has 
its  own  independent  sensor  to  take  measurements.  In  truth,  the  sensors  are  coupled  to  some  extent 
[17].  This  causes  off-diagonal  terms  in  the  R  matrix.  Before  we  described  R  as  being  the  expected 
value  of  the  measurement  noise  times  the  transpose  of  that  noise.  It  is  shown  from  Eq.  (20)  that 
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the  measurement  noise  is  actually  a  noise  vector,  V.  This  noise  vector  now  produces  off-diagonal 
terms  in  the  R  matrix. 


R,  using  a  two  parameter  example,  is  now  defined  as 

(  (  \  ^ 

R  =  E{VV'^)  =  e\  :  {Vk+i  Vk+N) 

\  \  Vk+N  j  j 

((  '^k+l  -  0.lVk  \ 

'^k+2  —  O-l^k+l 


=  E 


E 


\ 


(  ^fe+l  -  0,lVk  Vfc+2  -  aiVk+\  •  •  •  Vk+N  -  0,\Vk+N-l  ) 


\  Vk+N  —  O^lVk+N-l  J 

(  (Vk+i  -  aiVk)  (Vk+I  -  aiVk)  {vk+i  -  a-^Vk)  {vk+2  -  aiVk+i) 
{Vk+2  —  0,lVk+l)  (ffc+1  —  dlVk)  (^fc-t-2  —  O'lVk+l)  {Vk+2  —  «l^fc+l) 


J 


V 


Finally, 


(j^  -T  a^cr^ 

—aa^ 

0 

0 

—acr^ 

(T^  -|-  0^(7^ 

— acr^ 

0 

0 

—aa^  ( 

-1-  0^(7^ 

—axT^ 

0 

0 

—ao^ 

0 

—aa^ 

/  l  +  a2 

—a  0 

—a 

1  -}-  — a 

R  =  (j^ 

0 

—a 

0 

•••  J 


(26) 


V  •••/ 

In  summary,  the  parameters  of  an  unknown  plant  can  be  identified  by  using  a  sinusoidal  test 
function  as  an  input  to  that  unknown  plant  and  observing  the  phasor  output.  However,  care  must 
be  taken  not  to  over-model  the  unknown  plant.  When  noise  is  included  in  the  system  dynamcis, 
stochastic  analysis  must  be  used  to  account  for  the  effects.  A  discrete-time  model  was  given  and 
the  input  and  measurement  equations,  now  with  a  noise  term,  were  defined  .  It  was  then  shown 
how  the  strength  of  the  noise  can  be  represented  as  a  weighting  matrix,  R,  and  applied  to  the  state 
estimates  to  provide  more  accurate  results. 
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Chapters  -  Deterministic  Model 

A  physical  system  can  be  adequately  represented  as  a  mathematical  model  in  order  to  inves¬ 
tigate  its  dynamic  characteristics  and  system  responses.  Sensors  are  used  to  measure  the  states 
required  for  the  control  law.  The  control  law  is  simply  the  feedback  of  all  the  states  required  in 
the  system  identification  algorithm  [9].  It  will  be  discussed  further  in  Chapter  5.  Although  the 
proposed  plant  involves  using  a  stochastic  model  to  generate  the  state  estimates,  as  in  Fig.  1,  it 
is  necessary  to  create  a  deterministic  model  first.  The  deterministic  model  is  the  simplest  model. 
With  a  deterministic  model,  physical  noise  is  not  introduced  into  the  system.  By  removing  the 
noise,  the  model  and  mathematics  are  made  simpler.  This  allows  us  to  see  the  true  relationship 
between  the  input  command  and  the  output  responses.  It  also  helps  the  designer  determine  if  a 
compensator  is  needed  to  improve  system  performance.  The  desired  state  parameters  must  be  able 
to  be  calculated  deterministically  if  one  hopes  to  observe  them  later  when  noise  is  an  influence. 

3.1  Deterministic  Model  Setup 

The  aircraft  model  is  an  F-16  class  aircraft  flying  at  Mach  0.9  at  20,000  feet  and  the  (unstable) 
short  period  pitch  dynamics  approximation  is  used  [16].  The  relevant  states  are  a  and  q,  the  aircraft 
angle  of  attack  and  pitch  rate,  respectively,  and  the  control  variable  is  the  elevator  deflection  6e. 
The  plant  truth  model  used  in  the  system  identification  algorithm  is 

A  =  Za.Ot  ~\~  ZqQ  +  KZs^ 
q  =  MaOL  +  Mqq  -\-  KMg^ 

The  Z  derivatives  are 

Za  =  -1.3433,  Zq  =  0.9946,  =  -0.1525 

and  the  M  derivatives  are 

Me  =  3.5,  Mq  =  -1.0521,  Mse  =  -24.3282 


19 


In  continuous  state  space  form,  the  bare  aircraft  (plant)  dynamics  are 


X  =  Ax  +  bu 

(  -1.3433  0.9946  \  /  -0.1525  \ 

1.2915  -1.0521  J  ^  ^  -24.3282 


where  the  states 


X  = 


evolve  in  3?^  and  u  is  the  elevator  deflection  6e. 

The  input  is  three  pitch  rate  doublet  commands  (q  command),  having  an  amplitude  of  ±10 
degrees  and  a  period  of  4.5  seconds  giving  a  13.5  second  record.  The  doublets  are  passed  through 
a  low  pass  filter,  and  applied  to  a  unit  step  to  give  a  13.5  second  period  of  excitation  and  3 
seconds  of  steady  control  for  a  combined  16.5  seconds  of  data.  The  input  command  represents  a 
pilot  “exciting  the  stick”or  applying  dynamic  movement  to  the  aircraft’s  elevator. 

The  input  command  is  then  summed  with  the  states  a  and  q  using  state  feedback.  The  elevator 
command  then  goes  through  a  first  order  actuator  with  a  bandwidth  of  20.0  rad/sec,  .  This 
signal,  be-,  is  the  input  signal  into  the  plant. 

Augmenting  the  A  and  b  matrix  with  the  actuator  dynamics  yields 


where  the  states  are  now 


and  the  control  input  is  be 


and  the  actuator  dynamics  are 


± 

II 

b  u 

/ 

Z, 

=  Ma 

Mq 

\  0 

0 

T 

f  a 

X  = 


be^  —  f  (Aq,  ±  Kq  ±  Kg^')X 


i  If  If 

be  —  be  ±  Ug 

r  r 
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where  r  =  0.05  sec . 


The  closed  loop  A  matrix  is  now  formed  using  state  feedback.  The  resulting  A  and  b  closed 
loop  matrices  are 


+  b[K, 

.  -Kq  - 

-Ks.  ] 

(  Zo. 

Zq  Zfe 

\  / 

0  \ 

Ma 

Mq  M(g 

+ 

0 

V  0 

0  -i 

)  \ 

Za 

Zse 

Me. 

Mq 

Mse 

-\Kq  - 

so  we  get 

X  =  Aci  X  +  bciu 

The  system  as  is  will  not  track  a  step  input,  so  a  proportional  or  a  PI  controller  can  be  included  to 
adjust  the  tracking. 


3.2  Proportional  Controller 

To  find  the  gain  needed  to  improve  tracking  performance,  the  augmented  closed-loop  state 
space  equation  is  used.  The  reference  signal  r  (=  q)  is  the  exogenous  input  and  6c  =  KrV  —  KaOt  ~ 
Kqq  —  .  At  steady  state,  x  =  Ad  x  +  bKrV  ~  0.  Writing  the  augmented  state  space  equation 

with  the  necessary  gain,  K^,  at  steady  state 

0  =  Ad  X  +  Krbr 

and  solving  for  x  yields 

X  =  KrA'^^br 

Substituting  the  above  into  the  output  equation 

y  =  cx 
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gives  us 

y  =  Krc{A^^br) 

It  is  desired  for  the  output  to  track  a  step  input.  For  this  to  happen  y  =  r 

1  =  KrcA^i^b 

must  hold.  Solving  for  Kr,  yields 

K  =-i- 
"  cAcl--^b 

which  gives  the  required  gain  needed  for  proper  tracking.  This  gain  is  then  applied  to  the  system 
before  the  feedback  loop  as  shown  in  Fig.  1,  Chapter  1.  This  adjusts  our  Be;  to  the  following 

Bci={  0 

The  gains  needed  for  Ka,  Kg  and  are 

Kc,  =  0.283 
Kq  =  0.876 
Ks^  =  0.3 


3.3  PI  Controller 

Because  the  tracking  error,  or  steady  state  error,  is  large  but  the  transient  response  is  adequate, 
a  PI  controller  can  be  used  [8].  It  works  by  increasing  the  system  type  without  significantly 
changing  the  dominant  roots  of  the  characteristic  equation.  This  is  done  by  placing  a  zero  close  to 
the  origin  to  counteract  the  integrator  pole  located  at  the  origin.  This  way,  the  system  response  is 
maintained  veiy  close  to  the  original  and  the  tracking  error  is  reduced. 

Using  a  PI  controller  to  obtain  tracking  causes  the  A  and  b  matrices  to  change  because  of  the 
additional  integrator  state. 
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X  = 


where  the  states  are  now 


and  r  is  the  reference  signal.  Now, 

z  =  r  —  q 

The  new  Ad  and  Bd  matrices  are 

Aci  -  A  +  b[-Ka  -K,  -Ks^  K,] 


The  gains  needed  to  improve  tracking  performance  are 

Ka  =  0.283 
Kq  =  0.876 
Ks^  =  -0.4 
=  -0.0001 

In  this  chapter,  the  deterministic  model  of  the  thesis  problem  was  addressed.  It  was  shown  how  the 
actuator  dynamics  was  augmented  with  the  A  and  b  matrix,  and  the  control  law  defined.  Because 
the  control  system  could  not  properly  track  a  step  input,  a  proportional  and  a  PI  controller  were 
implemented  for  two  different  case  studies.  The  closed  loop  matrices  were  found  for  both  fixed 
controllers  and  the  gains  identified. 
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Chapter  4  -  Stochastic  Model 

A  deterministic  system  may  not  always  provide  a  complete  and  a  sufficient  method  for  data 
analysis.  There  are  three  basic  reasons  why  this  may  be  so  [13]. 

As  said  before,  a  physical  system  can  be  adequately  represented  as  a  mathematical  model. 
While  this  is  true,  it  also  says  that  no  model  is  a  perfect  model.  The  model  may  be  sufficient 
enough  to  observe  those  responses  the  designer  finds  important  but  many  physical  systems  are  very 
complex  and  nonlinear.  Nonlinear  systems  are  often  linearized  about  some  nominal  point  and  the 
higher  order  terms  are  often  neglected  to  make  algorithms  simpler  and  reduce  computer  processing 
time.  Therefore,  mathematical  models  are  designed  with  error  and  uncertainty  in  it. 

Dynamic  systems,  such  as  an  aircraft,  are  not  just  controlled  by  the  user.  Many  external 
sources  also  serve  as  inputs  into  the  system.  These  disturbances  can  come  from  wind,  moisture, 
computer  and  actuator  system  delays.  In  short,  most  systems  cannot  be  represented  as  a  single 
input  system.  Factors  are  always  present  that  can’t  be  modeled  in  a  deterministic  system. 

Just  as  mathematical  models  are  not  perfect  models,  sensors,  or  measurement  devices,  are  not 
perfect  either.  When  states  are  measured  using  a  device  external  to  the  model,  imperfections  are 
introduced.  Therefore,  the  measurements  displayed  by  the  sensor  are  corrupted  by  its  own  design 
imperfections,  system  responses  and  noise.  Another  problem  with  sensors  is  that  not  all  system 
variables  are  able  to  be  measured  with  a  common  sensor  device.  For  these  situations,  and  for  the 
reasons  above,  a  stochastic  estimation  model  is  used. 

A  stochastic  system  model  is  created  with  the  help  of  a  Kalman  filter.  A  Kalman  filter  is 
basically  a  data  processing  algorithm  that  uses  all  available  data,  such  as  initial  conditions,  plant 
model,  and  statistical  descriptions  of  any  biases,  noise  or  model  uncertainty.  This  information  is 
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fed  into  the  propagate/update  algorithm  which  then  optimally  derives  an  estimated  value  for  the 
system  states  or  any  other  variables  of  interest  in  a  way  that  minimizes  error. 

4.1  Recursive  System  Identification  Algorithm 

The  novel  loop  gain  system  identification  algorithm  is  stated  in  Theorem  1.  Since  measure¬ 
ment  noise  is  now  being  introduced  into  the  system,  a  discrete-time  model  is  used. 


Theorem  IConsider  the  following  linear  estimation  problem.  The  linear  dynamical  system  is 


^/c-i-i  —  Acc],^  “h  Khuj^  "1"  Oj  Ij  ...5  N  1, 

E{wkwl)  =  Q 

(27a) 

The  prior  information  is 

Xq  —  N  {xq  •)  Pox) 

(28a) 

K  =  N{Ko,Po,) 

(28b) 

The  output  signal 

y/c-f-i  =  Cxk+i 

(29) 

and  the  observation  equation  is 

Zk+\  =  yfc+1  +  E{'^k+\'Vkj,i)  = 

R. 

(30a) 

The  martices  A,  b,  C  and  T  are  known.  The  respective  process  noise  and  measurement  noise 
covariance  matrices,  Q  and  R,  are  also  known. 


Denote  by  Xk  and  Kk  the  respective  estimates  of  the  state  at  time  k,  Xk  and  the  loop  gain  K, 
given  the  measurements  record  zi,...Zk,  the  input  sequence  uq,  ...,  Uk-i,  and  the  prior  information 

on  Xo  and  K.  The  covariance  of  the  estimation  error  of  the  (  vector  is  denoted  by  the 


partitioned  matrix  Pk 


■Pfcii  Pk„K 

PkKK  ) 


Initially,  set 

Xo^Xo,  Ko  =  Ko,  Pc^APo..  Po.k=0. 

Then  for  A:  =  0, 1, ...,  iV  —  1,  the  state  and  gain  estimates  are 

Xk-\-i  ”  AXk  -f  -|-  CJ AXk  k^k^^^k'}  (^1) 

kk+1  =  kk+  KKizk+i  -  CAxk  -  KkCbuk)  (32) 

where  the  Kalman  gains 

Kx  =  {APk^^A^C^  +  Uk[Apk^ACbf'  +  KCApk^,f\ 

+ulpk.,h{Chf  +  TQT'^C^}  X  {CAPk^A^C^ 

+Uk[CApk^ACbf  +  {Cb){CApk^,f] 

WkPk^^  {Cb){Cbf  +  CTQT'^CF  +  (33a) 

and 

Kk  =  [{CApk^^f +  UkPk,ACbf\x{CAPk^.A^C'^ 

+Uk[CApk.ACbf'  -b  {Cb){CApk^,f] 

+ulPk..  {Cb){Cbf  +  CVQT'^C'^  +  R)-^  (34) 
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Furthermore,  the  estimation  error  covariances  are 

+ukPk^^hh^  +  rgr^]-!  +  c'^r-^c}-^  (35) 

Pfc+iKK  =  Pk..-[{CAvk..f  FukPk.AChfMCAPk^^A^C'^ 

+Uk[CApk^,{Chf  +  {Ch){CApk^,f]+ulpk,,{Cb){Chf 
FCTQT^C'^  +  R]-\CApk^,  +  UkPk^^  iCh))  (36) 

Pk+I.K  =  Apk,^  +  UkPkj^K  b  -  {APk,.  A^c'^  +  Uk  {Cbf 

+h{CApk,,S]  +  ulpk^,b{Cbf  +  TQTV}  X 

{CAPk^AV  +  UklCApk^,  {Cbf  +  {Cb){CApk^,f] 

+4Pk.ACb){Cbf  +  CTQT^C^  +  R}-^  X 

(CApk^^+UkPk^KiCb))  (37) 


4.2  Proof  of  Theorem 

The  proof  of  Theorem  1  is  given  below: 

Since  the  unknown  loop  gain  iT  is  a  constant,  we  augment  the  dynamics  as  follows. 

Kk+i  =  Kk  (38) 

Hence,  the  augmented  state  dynamics  evolve  in  5i”'’‘^and  are 

(s:'.)=(o 

and  the  measurement  equation  is 

^w  =  (c  ;  o)(^7;J+-'w  (40) 

As  you  can  see,  the  equations  are  similar  to  that  of  the  deterministic  model  except  for  noise 
now  being  modeled  into  the  system.  Here,  the  Wk  and  represent  the  process  noise  and  mea¬ 
surement  noise  respectively.  The  covariances  of  these  noises  are  represented  as  Q  and  R  in  the 
stochastic  model.  The  values  of  Q  and  R  were  defined  in  Chapter  1 . 


The  prior  information  at  time  k  is 


where 


^k(^x,K) 

is  the  estimation  error  covariance  matrix. 


Pk^K  PkKK  / 


(42) 


Note:  The  estimation  error  covariance  matrix  is  partitioned  as  follows. 

Hence,  before  the  Zfc+i  measurement  is  recorded,  the  augmented  state 
=  N 


( 


a:fc+i 

Kk+i 


A  Ukb 
0  1 


Xk 

Kk 


f  A  Ukb  \  (  A^  0\  (  TQr^  0  \\ 

V  0  1  J  i)  +  [  0  G  )) 


(43) 


j\T  f  f  -^Xk  H“  P^k^^k 

VV  Kk 

^  ^Pk^^A?-  +  Uk{APk^,^b^+ 

bpim  +  ulpk^^bb^  +  TQT^ 


V  pZ^A'^  AUkPkKK^'^ 

Next,  apply  the  Bayesian  estimation  formula 


X 


+  ^x-  +K[z-  Hx] 


Apk^K  +  ^kPk^^h 


Pk, 


VIZ., 


^fc+1 

Kk+i 


Axk  +  Kkbuk 

Kk 

Axk  +  Kkbuk 
Kk 


Zk+i-{  C  :  0  ) 


+  K  (zk+i  -  CAxk  -  UkKkCb^ 


Axk  +  Kkbuk 


Kk 
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where  the  Kalman  gain 


K 


+ulPk.,bbT +  rQTT 


^PfcxK  +WfcPfeKK^ 


V  Pfclj,^^+«A=PfcKK^^  :  PkKK 

)  X  {C^Pfc,,A^C^  +  Ufc[CApfe,,(C6)^  +  (C6)(CApfc,J^] 


+  ulpk,ACb){Cbf  +  CTQT^C'^  +  R}-^ 


(  APk^^A^CF  +  UkiApk^ACbf  +  biCApk^,)'^]  \ 
+ulpk^^b{Cbf +  TQrTC^ 

V  {CApk^^  f  +  UkPk^^  (Cbf  J 

{CAPk^^A'^C^  +  UklCApk^JCbf  +  Cb(CApk^j'^] 

+4pk^jcb)(cbf  +  crgr^c^  +  r}-^ 


Finally, 


^k-i-l(x,K)  ~  ^k(x,K)  ^^^k(^x,K) 


Hence,  we  calculate 


/ 


APk^^A^  +  Uk{Apk,^b'^+ 

+  ^kPkKKbb'^  +  TQr^ 


-Pfc+i 


(x,iC) 


Apk.^  +  UkPk^^b  ^ 


V  PLk^^  +'^kPkKKb'^  '■  PkKK  / 

{APk^A^C'^  +  Uk[Apk^,  (Cbf  +  b(CApk^J^j 
+4pk,j(Cbf  +  rQr^c^}  x  {CAPk^^A^c^ 
+UklCApk^JCbf  +  (CbXCApk^J^j  +  ulpk,,{Cb){Cbf 

+CTQT'^Cf^  +  i?}-i  X  [CAPk^^A^  +  Uk{CApk^J^ 

+Cbpl^AT)  +  ulpk^^Cbb^  +  CTQr^] 


[{CApk^.r  +  UkPk,ACbr]  X  {CAPk^^A^CA 
+Uk[CApk^ACbf  +  {CbXCApk^A'^]  +  ulpk,ACb){Cbf 

+C'rQr^C^  +  i?}-i  X  [CAPk^^A'^  +  Uk{CApk^A'^ 
'^^bPk^j^A'^)  +  u\pkK^Cbb'^  +  CFQr^] 


{APk^A^CF  +  Uk[Apk^,  {Cbr  +  hiCApk^A^] 
+ulpk,A{Cbr  +  TQV^CA  X  {CAPk^A^CA 
+Uk[CApk^ACb)'^  +  {ChXCApk^A'^]  +ulpk,ACb){Cb)T 

+CTQT'^C'^  +  R}-^  X  {CApk^^  +  UkPk.ACb)) 


[{CApk^A'^  PukPk.ACbn  X  {CAPk^,^A^C^ 

+Uk[CApk^ACbY  +  {Cb)(CApk^A^]+ulpk,ACb){Cbf 

+CrQT^C^  +  R}-^  X  (CApk^^+UkPk^ACb)) 
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Thus, 

•Pfc+ixx  =  +  UkiApk^^b'^  +  bpl^^A^)  +  ulpk^^bb'^ 

+TQT^]{[APk^A'^  +  UkiApk^^b'^  +  bpl^A'^) 

+  '^kPkKK^b^  +  TQT'^]-^  -  C'^{CAPk,,A^C'^ 

+Uk{CApk^ACbf  +  {Cb){CApk^,f]  +  ulpk,,{Cb){Cbf 
+CrQr^C^  +  R}-^C}[APk^^A^  +  UkiApk^y  +  bpl^A^) 

AUkPk^jibb^  +  TQT^]  (49) 

Next,  recall  the  complete  Matrix  Inversion  Lemma  (MIL). 

Lemma  lAssume  relevant  matrices  are  compatible  and  invertible.  Then 

(^1  ~  ^2^14  ^-^3)  ^  =  A^^  +  A.^^  A^^Aj^  —  A^A.^^^  A2)~^  A'iA^^  (50) 

□ 

Applying  the  MIL  to  the  expression  in  the  outer  curly  brackets  from  Eq.  (49),  viz., 
{[APk^A^ + MApk.^b'^  +  bpl^A^)  +  ulpk^.bb^  +  rgr^]-! 
-C^iCAPk^A^C^  +  UkiCApk^ACbf'  +  {Cb){CApk^,f] 
+UkPk^ACb){Cbf  +  CTQT'^C'^  +  R}-^C}-^ 

where  we  set 

Ai  =  [APk^^A'^  +  UkiApk^^b^  +  bpl^A'^)+ulpk^^bb'^  +  TQr^]-^ 

A2  = 

Az  =  C 

A4  =  {CAPk^^A'^C^  +  Uk[CApk^ACbf  +  {Cb){CApk^,f] 
+4pkKACb)(Cbf  +  crgr^c^  +  i?} 

we  obtain 
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{[APk^^A^  +  Uk{Apk^y  +  hvl^AT)  +  +  rgr^J-i  -  Cf^iCAPk^^A^CF 


+Uk[CApk^,{CbY  +  {Cb){CApk^^Y\  +  ulpk,,{Cb){Cbf  +  CVQT'^C^  +  i?}-iC}-i 
=  [APk^^A^ + ukiApk^j^  +  bpl^A^)  +  ulpk^.bb^  +  rgr^]  +  [APk^^A^ 
+Uk{Apk^J^  +  bpl^A^)+ulpk,,bb^  +  rQr^]C^{{CAPk^^A^(y^  +  Uk[CApk^^^^^ 
+{Cb){CApk^,f] + ulpk,,  {Cb){Cbf  +  crgr^c^ +r}-  ciAPk^^A^ + uk{Apk^,bT 
+bpl^AT)  +  ulpk^^bb^  +  TQT'^]C^}-^C[APk^^A^  +  u^iApk^^b^  +  bpl^A^) 
+ulpk,,bbT +  TQTT] 

Reducing  the  above  gives 

+  Uk{Apk^^b'^  +  bp'^^^A?')  +  u\pk^^bb'^  +  TQT'^]{[APk^^A?'  +  Uk{Apk^^b'^ 
+^fcxi<^^)  +  '^PkKK^b'^  +  rgr^]-!  +  C^R-^C}[APk^^A'^  +  UkiApk^^b'^  +  bpl^^A^) 
+ulpk,,bbT +  VQT'^] 
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Hence,  Eq.  (49)  can  now  be  reduced  to: 

Pk+u.  =  +  MAPk^Kb'^  +  bpl^^A'^) 

+ulPk.^bb^  +  rgr^]-'  +  c^r-^c}-^  (52) 

In  addition, 

Pk+lKK  =  PkKK  -  [{CApk,^  Y  +  UkPkKK  {Cbf]  {CAPk^^A^C'^ 

+Uk[CApk^,{CbY  +  {Cb){CApk^,f]+ulpk,,{Cb){CbY 
+CrQr^C^  +  R}-\CApk^,  +  UkPk^,  {Cb))  (53) 

and 

Pk+UK  =  Apk^^  +  UkPkKK  b  -  {APk,^  A^C"^  +  «fc  [Apk,^  {CbY 

+b{CAPk^,f]  +  ulpk,,b{Cbf  +  TQT'^C'^}  X 

{CAPk^^AV  +Uk[CApk^,{Cbf  +  {Cb){CApk^,f] 
+ulpk,,{Cb)iCbf  +  CTQT'^C'^  +  R}-\CApk^^ 

+UkPk.ACb))  (54) 

We  also  partition  the  Kalman  gain  vector  as  follows 


where 

Kx  =  {APk^^A^C^  +  UklApk^ACbf  +  b{CApk^,f] 

+ulpk,,b{Cbf +  TQr^C^}  X  CAPk^A^C^ 

Puk[CApk^ACbf  +  {Ch){CApk,,f\  +ulpk,,{Cb){Cbf 
+crQr^c^  +  R}-^ 
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and 


Kk  =  [{CApk^j'^ +UkPk^^{Cbf]{CAPk^^A^C'^ 

+Uk[CApk,^{Cbf  +  {Cb){CApk,^f]+ulpk^^{Cb){Cb)'^ 

+CTQr'^C'^ +  R}-^  (57) 

Hence, 

Xfe+I  =  Axk  +  Kkbuk  +  Kxizk+I  -  CAxk  -  KkCbuk)  (58) 

Kk+\  ~  Kk  Kj({^Zk^\  CAxk  KkCbuk)  (59) 

□ 


Remark  1  An  application  of  the  MIL  will  reduce  the  number  of  matrix  inversions  such  that  only 
th^  low-of'dsr  jficttrix 

CAPk^^A^C^  +  Uk[CApk^,{Chf  +  {Cb){CApk^,f\  +  ulpk,ACb){Chf 
+CTQV^C'^  +  R 
needs  to  be  inverted. 

4.3  Discussion 

It  is  important  to  realize  that  the  absence  of  complete  plant  information,  viz.,  the  uncertainty 
in  the  loop  gain  parameter  K,  causes  both  the  loop  gain  and  the  state  estimation  error  covariances 
to  be  dependent  on  the  input  signal  -  see,  e.g.,  Eqs.  (34)-(37).  This  is  a  major  departure  from 
the  classical  state  estimation  paradigm  in  linear  control  theory.  Thus,  the  loop  gain  estimate  K 
(and  also  the  loop  gain  estimation  error  covariance)  are  now  time  dependent.  Obviously,  the  best 
loop  gain  estimate  is  obtained  at  the  end  of  the  estimation  interval,  at  time  N.  In  addition,  the 
algorithm-provided  loop  gain  and  state  estimates  are  correlated.  Furthermore,  the  loop  gain  and 
state  estimates’  dependence  on  the  input  signal  is  nonlinear.  The  input  signal  dependence  of  the 


loop  gain  and  state  estimation  error  covariances,  is  a  unique  manifestation  of  the  dual  control  effect. 
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4.3.1  Special  Example  1 

Consider  the  classical  Kalman  Filter  paradigm  where  K  is  known,  i.e.,  K=1 .  In  this  special 

case 


Pokk  =  0)  Po^K  =  0)  PkKK  =  0)  Pk^K  =0  for  all  A:  =  1, 2, . 
and  it  follows  that 


Pk 

=  Pk 

(60) 

Kk 

=  0 

(61) 

K^ 

=  (APk^^A^  +  TQV'^)C'^{CAPk.^ATc'^ 

(62) 

fc“h  Ixx 

=  [(APk^^A^  +  rgr^)-^  +  c'^r-'^c]-^ 

(63) 

Thus,  the  classical  Kalman  filter  formulae  are  recovered. 


□ 


Remark  2  If  Xq  is  known,  viz.,  Xq  =  N{xoj  0),  i.e.,  =  0,  and  only  the  loop  gain  parameter  K 

is  not  known,  Le.,  =  0,  0,  one  nevertheless  has  to  deal  with  an  uncertain  x  at  time  k 


(even  ifV^O  and  if  there  is  no  process  noise)  and  one  must  propagate 


Kk 


4.3.2  Special  Example  2 

Special  case:  C  is  a  row  vector  (i.e., a  scalar  measurement  is  being  used). 

Then  the  estimation  algorithm  is 

■^fc+1  =  -^Jt  +  KK{zk.\-i  -  CAxk  —  Kk{Ch)uk) 
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(65) 


where  the  Kalman  gain  for  state  estimation  is: 


Kx  —  +  Uk[{Cb)Apk^^  +  {CApk^j^)b] 

+4{Cb)pk,J  +  TQT'^C^} 

and  where  the  scalar  X  is  given  by: 

X  4  CAPk^^A^C^ +  2uk[iCb)CApk^^ 

+ul{Cbfpk.,+CTQT^C'^  +  R 

The  Kalman  gain  for  loop  gain  estimation  is 

[CApk^^  +Uk{Cb)pk 

kk] 


Kk  = 


X 


Finally,  the  estimation  error  covariances  are 

-Pifc+I.x  =  { [APk..  ^  (^Pfc.K  b^  +  bpl^^  A^)  +  ulpk^^bb'^ 

+rQr^]-^  +  ^C^c}-^ 

Jti 


(66) 


(67) 


(68) 


(69) 


Pk+\KK  P^KK 


[CApk,^  +  Uk{Cb)pk^J‘^ 
X 


(70) 


Pk+l^K  ~  -^PkxK  "b  '^kPkxK^  ' 


C^Pk^^K  +Uk{Cb)Pkj, 
X 


{APk^^A'^C'^  +  Uk[{Cb)Apk^,  +  {CApk^M 
+ul{Cb)pk^,b  +  TQr'^C^} 


4.4  Alternative,  Batch  Approach  to  Estimation 

The  system  state 


fc-i 


k-i 


i=0 


i=0 


(71) 


Xk  =  A^Xo  A^-^-%Ui  +  ^  A’^-'^-^Twi,  k  =  l,2,...N-l  (72) 
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and  the  measurement 


k~l 


k-1 


Zk  =  CA'^Xo  +  K'^CA'^-'^-^bui  +  ^CA’^-'^-^Twi 


i=0 


i=0 


CA^  ^'^CA^-^-^bui 

i—O 


Xo 

K 


^fc-i 


»^2=0 


This  yields  the  linear  regression 


where 


where 


and  where 


Z  =  HQ +  V 


0  = 


H  4 


Xq 

K 


( 


\  ■Z’at-i 

/  CA 


(ra+l)xl 


(Ar-l)xl 


Wh  \ 


CA^-^  ^Zuk-i-iCA^b 

i=0 


k-1 


Vk  4  ^C7ATt/;fc_i_i  + 


^k 


i=0 


R  4  E{VV'^) 

n  ^ 

tn-i  / 

Vk  =  Y^CA^PQP'^{A'^)C'^  +  R. 


R  =  Diag 


k-1 


i=0 

The  window  length  is  N-1 . 

This  linear  regression  is  augmented  by  the  prior  information  equations 

Xo  =  Xo+Wk,  E{Wxw1)  =  Pox 
Ko  =  K  +  Wk^  E{wl)  =  Pok 


(73a) 

(73b) 

(74) 

(75a) 

(75b) 


(75c) 

(75d) 

(75e) 

(76) 

(77) 


(78a) 

(78b) 
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i.e.,  the  above  linear  regression  is  augmented  to  include 

=  /jv+i©  +  W 


Xo 

Ko 


E{WW^)  = 

Hence,  the  augmented  linear  regression  is 
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In  summary,  a  system  identification  algorithm  was  developed  to  identify  a  systems’  loop  gain, 


K.  A  proof  of  this  theorem,  was  given  and  supporting  examples  discussed.  An  alternative  batch 
approach  to  loop  gain  estimation  was  also  given. 


37 


Chapters  -  Results 


5.1  Zero  Order  Hold 

The  commanded  pitch  rate  is  a  continuous  signal  created  by  the  pilots’  force  on  the  stick. 
The  signal  is  fed  into  the  plant  and  is  passed  through  a  analog  to  digital  (A/D)  converter  and  is 
sampled.  This  digital  response  contains  a  delay  caused  by  the  hold  in  the  sample  process.  A  delay 
in  the  feedback  loop  corrupts  the  damping  and  stability  of  the  system.  This  delay  is  shown  to 
be  represented  [9]  using  a  first  order  approximation  where  the  continuous  signal  lags  the  sampled 
signal  by 

where  T  is  the  sample  period  and  1/T  is  the  sample  rate  given  as  cycles  per  second  or  Hz.  When 
the  signal,  u(t),  is  being  sampled  at  every  kT  points,  0<  k  <  oo,  the  value  of  the  signal  at  u(kT)  is 
held  to  the  next  sample  point  (k+l)T.  This  gives  a  “stair  case”  estimate  of  the  signal.  Using  the 
first  harmonic  approximation,  which  is  essentially  the  average  of  the  sampled  signal  u(kT),  we  get 
the  input  signal.  However,  the  new  signal  is  shifted,  or  delayed,  by  the  size  of  the  sample  period. 
The  following  figure  shows  how  the  digital  control  system  delays  a  signal  following  a  step  input. 
When  the  sample  period  is  decreased,  the  delay  gets  smaller  and  follows  the  continuous  signal  more 
exactly  -  see,  e.g..  Figs.  11  and  12. 

5.2  Experimental  Setup  and  Tracking  Control 

One  would  like  a  feedback  control  system  to  be  robust  enough  to  perform  within  specifications 
in  the  face  of  parametric  uncertainty,  e.g.,  control  surface  loss  due  to  failures.  As  the  critical  open- 
loop  gain  K  decreases  from  one  to  zero,  which  represents  a  transition  from  no  failure  to  complete 
control  surface  loss,  the  tracking  of  the  reference  signal  begins  to  slip.  Even  though  failure,  viz.,  a 
reduction  in  the  control  derivative,  causes  a  fixed  controller’s  tracking  performance  to  deteriorate. 
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output  y  output  y 


Short  Period  Outputs 


Figure  12.  Efects  of  discritization  on  the  commanded  continuous  input;  Pitch  rate  is  the  discrete 
signal 
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still,  a  correct  system  identification  algorithm  will  properly  estimate  the  degree  of  failure.  Hence, 
one  is  motivated  to  use  on-line  system  identification  and  adjust  the  controller’s  gain  on  line  in 
order  to  account  for  the  failure-induced  reduction  in  open-loop  gain,  thus  achieving  adaptive  and 
reconfigurable  control. 


Figure  13.  Aircraft  elevator  damage 


In  our  simulation,  a  control  surface  failure  is  induced  at  4.5  seconds  into  the  flight  for  all  the 
test  runs.  This  translates  into  a  jump  in  K  from  1  to  K=Ki ,  0  <Ki  <  1 .  Hence,  the  degree  of  failure 
is  parameterized  by  Ki . 

In  addition,  measurement  (sensor)  noise  is  injected  into  the  simulation.  Thus,  the  measured 
pitch  rate  is  9  +  Vg,  where  Vg  =  N{0,  (T^),  and  the  measured  angle  of  attack  is  am  =  oi  +  Va, 
where  Va  =  N{0,  cr^ ).  Given  that  both  a  and  q  observations  are  used  for  system  identification,  the 
following  definition  of  SNR  is  used: 


SNR  ^20  log 


ry2  I 

^max  '  ^max 

2  (0-2  +  w2o-2) 


(82) 


where  the  weighting 


w : 


\Apm\ 


[sec] 
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and  pi,  p2  are  the  poles  of  the  open-loop  plant  (the  short  period  approximation): 


Pi  =  -0.6737  P2  =  0.30691 


In  our  simulations, 


6°,  g„,ax  ~  11°- 


The  experimental  results  presented  in  Figs.  14-31  were  obtained  using  a  fixed  cra=0.03  deg. 

For  the  SNR  experiments  of  40  and  60  dB,  a  scaled  aq  and  ctq  are  used.  We  initially  let 
cTg  =  0.05  deg  /  sec,  and  ctq,  =  0.05  deg  and  we  set 

(83a) 

(Jq;  =  kaa  (83b) 

where  the  SNR  scaling  parameter  k  >  0.  The  SNR  is  now  expressed  as 


(Jq  —  k(Tq 


SNR{k)  ^20\og, 


^  \2  {crl  +  w^af)  j 
and  therefore,  for  a  specified  SNR,  the  parameter  k  is  determined  according  to 


-t- 

'^max  '  ^  Him 


k  = 


(Y^  4-  w^o 

^max  ~  ^  H] 


2n2 


2  {al  +  w2a2) 


lO" 


(84) 


and  in  the  simulation  experiments  <7q  and  (7a  are  adjusted  according  to  Eqs.  (83a)  and  (83b), 
respectively.  The  cr^,  cTa  and  SNR  values  are  shown  in  Table  1 . 

Table  1.  SNR  values  using  a  constant  (Ja=0.03  deg 


Uq  deg/sec 

<7 a  deg 

SNRdB 

0.55534 

0.03 

23.29 

0.1108 

0.03 

37.227 

0.0739 

0.739 

40 

0.01108 

0.03 

53.286 

0.00739 

0.00739 

60 
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5.2.1  Tracking  Control 

The  F-16  class  plant  is  open-loop  unstable.  This  is  a  normal  characteristic  of  advanced  fighter 
aircraft.  Using  full  state  feedback,  the  flight  control  system  can  be  stabilized.  The  ensuing  closed 
loop  linear  state  feedback  control  system  is  very  robust;  a  well  designed  robust  tracking  controller 
can  handle  an  open-loop  gain  as  low  as  K=0.08.  At  lower  K  values,  the  feedback  stabilization 
action  becomes  ineffective  and  the  closed  loop  system  becomes  unstable.  In  this  work,  two  tracking 
controllers  are  considered,  a  Proportional  and  Integral  (PI)  controller  and  a  proportional  controller. 

5.2.1. 1  PI  Controller 

Tracking  is  achieved  using  a  fixed  PI  controller.  The  control  law  is 
6e^=r-  KaOi  -  Kqq  -  Ksje  +  KzZ 

where  the  reference  signal  is  the  commanded  pitch  rate  r=qc,  and  where  z  is  the  “charge”  on  the 
integrator  of  the  PI  controller.  The  controller  gains  are  =  -0.0001,  =  0.283,  Kg=  0.876  and 

=  -0.4.  Table  1  shows  the  eigenvalues  of  the  open-loop  plant  and  the  closed-loop  system  when 
this  PI  controller  is  used  for  tracking  control. 


Table  2.  Longitudinal  dynamics 


Open-loop  Plant 

Closed-loop  System,  K=0.08 

N/A 

-14.4614+15.504) 

-26.6776 

0.6737 

-14.4614-15.504j 

-3.7210 

-3.0691 

-1.4724 

0.0016 +  0.0071J 

-20.0 

0 

0.0016 -0.0071j 

As  can  be  seen,  the  bare  plant  is  originally  open-loop  unstable.  State  feedback  stabilizes  the 
a,  q,  and  6e  states  of  the  unimpaired  closed-loop  flight  control  system.  As  the  critical  loop  gain 
K  is  lowered  from  a  value  of  1 ,  which  corresponds  to  having  no  failure,  to  an  almost  complete 
longitudinal  control  surface  loss  at  a  value  of  K?s0.08,  the  closed-loop  system  reverts  to  instability 
again. 
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In  the  tracking  control  experiments  the  above  designed  fixed  PI  controller  is  used.  In  the 
simulations,  at  time  t=4.5  sec.  into  the  flight,  the  open-loop  gain  K  is  reduced  to  =  K\  =0.8, 
K  =  Ki  =0.6,  K  =  Ki  =0.4,  K  =  Ki  =0.2  and  K  =  K\  =0.1.  Although  no  loss  in  post-failure 
tracking  performance  is  recorded  for  Ki=0.8  in  Fig.  14  (due  to  the  robustness  of  the  controller), 
a  discernible  loss  in  tracking  performance  is  evident  for  Ki=0.6,  as  is  shown  in  Fig.  15,  and  the 
degradation  in  tracking  performance  is  more  pronounced  for  Ki=0.4  and  Ki=0.2  in  Figs.  16  and 
17,  respectively.  Although  the  control  system  does  not  become  unstable  until  a  degree  of  failure 
which  corresponds  to  Ki=0.08,  the  post-failure  tracking  performance  of  the  PI  controller  falls  out 
of  acceptable  limits  before  this  point,  approximately  when  the  loop  gain  Ki  <0.25  -  see,  e.g.  Fig. 
17,  where  the  results  for  Ki=0.2  are  shown.  When  the  K  value  decreases  further  to  Ki=0.1  and 
below,  as  shown  in  Fig.  18,  post-failure  tracking  performance  of  the  fixed  controller  deteriorates 
greatly,  although  stability  is  still  preserved  until  Ki=0.08. 

S  hort  P  eriod  Outputs 


Figure  14.  Pitch  rate  and  alpha  response  for  a  loop  gain  of  Ki=0.8,  aq  —  0.1108  deg /sec, 
=  0.03  deg  and  SNR=37.227  dB 
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S  ho  rt  P  eriod  Outputs 


Figure  17.  Pitch  rate  and  alpha  response  for  a  loop  gain  of  Ki=0.2,  aq  —  0.1108 deg/ sec, 
(T„  =  0.03  deg  and  SNR=3  7.227  dB 


S  hort  P  eriod  O  utputs 


Figure  18.  Pitch  rate  and  alpha  response  for  a  loop  gain  of  Ki=0.1,  aq  =  0.1108  deg /sec, 
(Ja  =  0.03  deg  and  SNR=37.227  dB 
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Figs.  19  and  20  show  the  state  estimates,  as  calculated  from  the  system  identification  algo¬ 
rithm,  for  a  degree  of  failure  of  Ki=0.8  and  Ki=0.2.  After  the  point  of  failure,  some  error  between 
the  estimated  pitch  rate  and  the  commanded  pitch  rate  can  be  seen.  The  state  estimates  improve  as 
time  increases,  converging  back  to  the  true  commanded  pitch  rate.  When  the  degree  of  failure  in¬ 
creases  to  Ki=0.2,  the  pitch  rate  estimate  error  also  increases.  With  the  low  SNR  and  high  degree 
of  failure,  the  system  identification  algorithm  shows  some  degradation  of  estimation  performance. 
The  loop  gain  K  estimation  performance  wil  be  shown  in  the  next  Section. 

State  Estimates  Using  System  Identification  Algorithm 


Figure  19.  Pitch  rate  and  alpha  estimates;  Ki=0.8,  cr,  =  0.1108  deg /sec,  Ua  =  0.03  deg  and 
SNR=3  7.227  dB 

5.2.I.2  Proportional  Controller 

Tracking  is  achieved  using  a  fixed  proportional  controller.  The  control  law  is  6e^  =  KrV  — 
Kaa  —  Kqq  —  where  the  reference  signal  r=qc.  The  controller’s  gains  are  Kr=  0.9964,  Ka  = 
0.283,  Kg  =  0.876  and  Kgg  =  -0.4.  Integral  action  is  not  used  to  enforce  tracking.  The  following 
table  shows  the  eigenvalues  of  the  closed-loop  system  using  the  proportional  tracking  controller. 
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Angle 


Table  3.  Longitudinal  Dynamics 


Open-loop  (Short  Period)  Plant 

Closed-loop  System,  K=1 

Closed-loop  System,  K=0.08 

-3.0691 

-1.4724 

0.0032 

0.6737 

-14.4615  +15.5040j 

-3.7210 

-20.0 

-14.4615  -15.5040j 

-26.6776 

Once  again,  the  open-loop  plant  is  unstable  and  feedback  stabilization  is  used.  The  closed- 
loop  system  becomes  unstable  again  when  the  degree  of  control  surface  loss  becomes  excessively 
large,  viz.,  Ki=0.08. 

In  general,  post  failure  tracking  performance  of  the  fixed  proportional  controller  for  the  vari¬ 
ous  reduced  open-loop  gain  values  is  similar  to  that  of  the  PI  controller.  The  post  failure  tracking 
performance  of  the  proportional  controller  becomes  unacceptable  when  the  critical  loop  gain  is  re¬ 
duced  to  Ki=0.2.  When  the  critical  loop  gain  is  further  reduced,  tracking  performance  deteriorates 
rapidly  as  shown  in  Figs.  2 1  and  22.  In  both  cases,  when  either  the  PI  tracking  controller  or  the  pro¬ 
portional  tracking  controller  were  used,  very  similar  identification  results  were  obtained.  Hence, 
the  identification  results  for  the  PI  controller  only  are  displayed 

5.3  Estimation  Performance 

When  a  fixed  linear  proportional  or  PI  tracking  controller  is  used  and  a  severe  failure  occurs, 
the  output  signal  of  the  plant  (q)  fails  to  follow  the  pitch  rate  command  signal  from  the  pilot  (the 
reference  signal  qc).  However,  even  in  the  case  of  severe  control  surface  loss  the  system  iden¬ 
tification  algorithm  (Theorem  1)  still  correctly  estimates  the  value  of  the  critical  open- loop  gain 
parameter  K. 

In  this  section,  the  estimation  performance  guaranteed  by  the  novel  system  identification 

algorithm  stated  in  Theorem  1  is  experimentally  investigated,  and  the  results  of  the  open-loop  gain 

identification  experiments  are  presented.  The  plant  truth  model  used  in  the  system  identification 
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Short  Period  Outputs 


Figure 21.  Pitch  rate  and  alpha  response  for  a  loop  gain  of  Ki=0.2,  aq  =  0.1108 deg /sec, 
aa  =  0.03  deg  and  SNR=37.227  dB 


S  hort  Period  Outputs 


Figure  22.  Pitch  rate  and  alpha  response  for  a  loop  gain  of  Ki=0.1,  aq  =  0.1108  deg /sec, 
(Ja  =  0.03  deg  and  SNR=3 7.227  dB 
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algorithm  is 


o.  —  ZccOi  +  Zqq  +  KZg^u 
q  =  MaCt  +  Mqq  +  KMg^u 

viz.,  the  state  ^  ^  ^  evolves  in  and  the  control  signal  is  u=6e.  A  discrete-time  version  of  the 
plant  which  corresponds  to  a  sampling  rate  of  lOOHz  is  embedded  in  the  system  identification  algo¬ 
rithm.  Furthermore,  the  prior  parameter  information  given  to  the  system  identification  algorithm  is 
intentionally  selected  to  be  poor.  It  therefore  takes  the  system  identification  algorithm  some  time 
to  settle  down  and  output  the  correct  parameter  estimates. 

The  system  identification  algorithm  is  able  to  estimate  the  open-loop  gain  for  a  high  degree 
of  failure,  even  in  the  presence  of  poor  tracking.  This  is  due  to  the  system’s  enhanced  excitation 
which  is  caused  by  poor  tracking  and  is  therefore  conducive  to  good  system  identification.  Figs. 
23-27  show  how  the  system  identification  algorithm  using  the  expanding  horizon  Kalman  filter 
(Theorem  1)  estimates  the  open-loop  gain  K  as  the  degree  of  failure  increases.  Because  of  the 
robustness  of  the  linear  controllers,  both  yielded  similar  tracking  performance  and  thus  similar 
identification  performance.  The  results  for  both  types  of  controllers  are  summarized  in  Table  4. 
The  true  and  the  identified  open-loop  gain  K  (for  both  the  PI  and  the  proportional  tracking  controller 
mechanizations)  are  shown. 


Table  4.  Open-Loop  Gain  Estimation  Performance  Analysis  for  Failure  time  of  4.5  sec 


Actual  Post  Failure 
Open-Loop  Gain 

Final 

Estimated  Value  K 

Relative 

Estimation  Error  (%) 

Settling  Time  (sec)  for 

20%  Gain  Estimation  Error 

0.8 

4.91 

ts=0.S2 

7.25 

ts=l.93 

7.11 

t,=2.1\ 

[llllllllll^^ 

0.2116 

5.48 

4=1.83 

0.1 

0.0996 

0.40 

4=1.51 
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The  identification  settling  time,  tg,  when  the  expanding  horizon  estimate  algorithm  is  used,  is 
dependent  on  the  degree  of  failure.  Thus,  a  fairly  good  (20%  error)  estimate  of  the  open-loop  gain 
is  obtained  within  2.71  seconds  after  the  failure.  These  estimates  were  obtained  using  an  expanding 
data  window  with  a  relatively  low  SNR=37.227  dB.  It  will  be  shown  in  the  next  section  how  the 
identification  time  can  be  reduced  using  a  moving  window  system  identification  algorithm. 

Open-Loop  Gain  Estimate 


Figure  23.  Open-loop  gain  estimimation  for  a  failure  of  Ki=0.8,  cr,  =  0.1108 deg /sec, 
o-a  =  0.03  deg  and  SNR=37.227  dB 


5.4  Moving  Window  Estimation 

A  moving  window  (or,  equivalently,  finite  memory  data  window)  is  used  because  in  the  case 
of  a  failure,  when  a  jump  in  the  value  of  the  open-loop  gain  K  occurs,  the  latter  is  identified  faster 
than  in  the  case  where  the  expanding  horizon  system  identification  algorithm  is  used.  By  using  the 
recursive  system  identification  algorithm  (Theorem  1)  inside  a  0.3  second  window  (of  30  samples), 
estimates  of  the  parameters  of  interest  are  calculated.  The  window  is  then  shifted  one  sample 
time  and  the  estimation  is  repeated.  This  gives  the  first  parameter  estimate  at  0.3  seconds  into  the 
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Figure  25.  Open- loop  gain  estimimation  for  a  failure  of  Ki=0.4,  Gq  =  0.1108  deg /sec, 
C7c  =  0.03  deg  and  SNR=37.227  dB 
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flight.  For  all  of  the  windows,  the  same  prior  information  of  a  =  —1.4414  degrees,  q  =  —2.4314 
degrees/second,  and  the  open-loop  gain  Ki  =  0.8,  are  used.  Prior  information  with  negative  a 
and  q  was  intentionally  used  to  test  the  windowed  estimation  algorithm’s  response  to  a  poor  initial 
guess.  The  initial  variances  are  0.1  [deg^],  1  |^(deg/sec)^j ,  and  0.4,  respectively. 

In  Fig.  28,  the  dashed  lines  represent  ±20%  error  from  the  true  degree  of  failure.  One  can 
see  that  the  moving  window  is  quicker  to  settle  on  an  estimate,  while  the  expanding  horizon  system 
identification  algorithm  takes  more  time  to  reach  its  final  estimate  value.  Obviously,  the  estimate 
provided  by  the  expanding  Kalman  filter  is  smoother  than  the  estimate  provided  by  our  relatively 
short  sliding  window.  At  the  same  time,  the  deleterious  effect  on  estimation  performance  of  a  very 
short  window  (<  0.3  sec)  is  also  evident  near  t=0  in  the  expanding  horizon  plots  in  Figs.  23-27. 


Critical  Loop  Gain  Estimate 


Figure  28.  Expanding  horizon  versus  moving  window  estimation;  Ki=0.6,  aq  =  0.1108  deg  /  sec, 
=  0.03  deg  and  SNR=37.227  dB 


Also  note  that  when  the  moving  window  system  identification  algorithm  is  used,  during  certain 
windows,  the  excitation  in  the  window  is  poor  and  these  particular  windows  yield  bad  parameter 
estimates.  These  “poor”  estimates  occur  when  the  window  slides  past  the  peaks  of  the  input 
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command,  as  shown  in  Fig.  29.  The  peaks  in  the  estimate  seem  to  be  correlated  to  the  input  peaks, 
as  is  evident  in  Fig.  29.  Indeed,  the  input  signal  strongly  affects  the  estimation  performance  of 
the  system  identification  algorithm  -  as  opposed  to  classical  linear  state  estimation,  i.e.,  Kalman 
filtering.  Obviously,  poor  estimates  are  also  recorded  during  periods  of  low  control  activity  as  is 
the  case  for  14<t<16  sec.. 

Input  Com  m  and  and  K  estimates 


Figure  29.  Input  command  versus  the  sliding  window  K  estimate;  Ki=0.6,  Uq  =  0.1108  deg  /  sec, 
(Tec  =  0.03  deg  and  SNR=37.227  dB 

To  reduce  the  fluctuations  in  the  K  estimates,  the  estimates  output  by  the  identification  algo¬ 
rithm  are  smoothed  through  a  first  order  low  pass  filter: 

Kk  smoothed  9*Kk- 

^smoothed  ^  Kk  (85) 

Thus,  the  current  estimate  is  given  less  weight  than  the  previous  estimate.  Smoothing  of  the  algo¬ 
rithm’s  output  (estimates)  helps  to  reduce  the  deleterious  effects  of  noise  and  improve  estimation 
performance.  However,  smoothing  increases  the  identification  time,  which  is  of  particular  impor¬ 
tance  in  a  failure  scenario.  In  Fig  30,  the  loop  gain  estimates  are  smoothed  using  various  gains.  As 
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can  be  seen,  when  =  -7  *  -^A:-l3„^oothed  +  -3  *  is  used,  the  delay  in  detection  time  is 

greater  than  the  unsmoothed  estimates  but  less  than  when  the  smoothing  gains  in  Eq.  (85)  is  used. 
A  reduction  in  detection  delay  comes  at  the  expense  of  less  smoothing.  One  must  decide  if  this 

Comparison  ofVarious  Smoothing  Percentages 
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Figure  30.  The  effects  of  smoothing  on  failure  detection  time;  Ki=0.6  and  SNR=37.227  dB 

is  an  appropriate  trade-off.  If  smoothing  is  not  an  option  then  increasing  the  window  length  also 

helps  to  reduce  the  deleterious  effect’s  of  noise,  and  hence  the  fluctuations  in  the  open-loop  gain 

estimate  K  are  reduced,  but  not  as  effectively.  In  this  work,  the  loop  gain  estimates  are  smoothed 

using  Eq.  (85).  Fig.  31  shows  the  effects  of  smoothing  on  the  loop  gain  estimate.  The  dashed 

lines,  once  again,  represent  a  ±20%  error  of  the  true  loop  gain,  K. 

Table  5  shows  the  time  needed  to  obtain  an  open-loop  gain  estimate  that  is  within  20%  of 

the  true  open-loop  gain  using  the  windowed  system  identification  algorithm.  The  open-loop  gain 

estimates  are  calculated  using  a  moving  window  and  are  smoothed.  It  is  shown  that,  as  the  failure 

degree  increases  (K  gets  smaller),  the  time  needed  to  identify  the  open-loop  gain  within  ±20%  of 

the  true  value,  increases.  As  expected,  the  smoothed  open-loop  gain  estimates  require  more  time 
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for  identification  than  the  original  moving  window  algorithm  provided  estimates.  An  estimate  of 
the  open-loop  gain  with  an  error  of  less  than  20%  can  be  obtained  after  0.23  seconds  using  the 
moving  window,  and  it  takes  0.5  seconds  when  the  estimates  are  low  pass  filtered  using  Eq.  (85). 
Nevertheless,  this  corresponds  to  a  shortened  identification  time,  viz.,  a  reduction  of  over  1  second 
in  identification  time  is  obtained  when  compared  to  the  expanding  horizon  algorithm’s  results  in 
Table  4.  Now,  the  settling  time  t^  is  monotonic  in  the  degree  of  failure,  as  expected. 


Table  5.  Time  to  Reach  20  Percent  of  True  Loop  Gain  After  Failure  at  4.5  sec 


Actual  Open-Loop 
Gain  After  Failure 

Settling  Time  for  20% 
Gain  Estimation  Error 
Using  Moving  Window 

Settling  Time  for  20% 

Gain  Estimation  Error  Using 
Moving  Window  with  Smoothing 

0.8 

^5=0.02 

t«=0.09 

0.6 

t«=0.08 

t*=0.17 

0.4 

ts=0.l2 

ts=0.26 

0.2 

ts=0.l9 

f^=0.44 

0.1 

ts=0.23 

t^=0.51 

5.5  SNR  Effects 

The  measurement  noise  intensity  has  a  strong  influence  on  how  the  moving  window  system 
identification  algorithm  estimates  the  plant’s  open-loop  gain.  In  the  previous  figures,  a  SNR  of 
37.227  dB  was  universally  used.  When  the  SNR  is  increased  to  53.286  dB,  the  identification 
performance  improves  and  the  estimates  are  smoother  -  see  Fig.  32.  However,  when  the  SNR  is 
lowered  to  23.29  dB,  the  identification  performance  deteriorates  and  estimates  become  more  erratic 
and  peaks  become  more  prominent,  especially  for  windows  that  contain  the  instant  of  failure  at 
t  =  4.5  sec.  -  see,  for  example.  Fig.  33.  Thus,  the  SNR  has  a  strong  influence  on  the  system 
identification  algorithm’s  ability  to  estimate  the  parameters. 

In  Fig.  34,  K  ±  2cr,  where  the  predicted  open-loop  gain  estimation  error  standard  deviation 
^  ~  \/PkxK  j  is  plotted.  It  is  expected  that  about  95  percent  of  the  estimates  will  fall  inside  these 
bounds.  As  can  been  seen  in  Fig  34,  most  of  the  estimates  calculated  from  the  moving  window  do 
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fall  within  these  bounds.  When  the  error  covariance  of  the  open-loop  gain  is  large,  the  estimates 
from  moving  window  identification  algorithm  are  poor.  This  occurs  when  there  are  high  dynamic 
changes  of  the  input  command.  Indeed,  Theorem  1  provides  a  rigorous  open-loop  gain  estimation 
algorithm.  Hence,  as  expected.  Fig.  34  amply  illustrates  that  “Kalman  filter  divergence”  does  not 
occur,  i.e.,  our  open-loop  estimate  is  indeed  reliable. 

Obviously,  K  is  within  the  limits  of  1  andO,  1  for  no  failure  and  0  for  a  complete  loss  of  control 

surface  area.  As  shown  in  Figs.  33,32, 36  and  38,  the  loop  gain  estimates  before  the  point  of  failure 
often  exceeded  Ki=l .  We  know  that  this  can  not  be  the  case.  The  plant’s  open-loop  gain  estimates 
provided  by  our  smoothed  moving  window  system  identification  algorithm  can  be  modified  using 
the  above  upper  and  lower  bound  information:  when  the  moving  window’s  identified  loop  gain 
estimates  are  greater  than  one  or  less  than  zero,  they  are  set  equal  to  their  respective  limits.  This 
will  reduce  the  estimated  loop  gain  fluctuations  before  they  are  smoothed. 

After  limiting  the  loop  gain  value  estimate  to  1  for  the  case  when  the  SNR  =  23.29  dB  and  the 

degree  of  failure  is  Ki  =  0.2,  the  open-loop  gain  identification  performance,  shown  in  Fig.  35,  is 
obtained  -  compare  to  Fig.  33. 

For  the  simulation  runs  presented  in  Figs.  36-39,  both  the  a  and  q  measurement  noise  intensity 
was  varied  according  to  Eqs.  (83a)  and  (83b).  As  can  be  seen,  as  the  SNR  increases  from  23  dB  to 
40  dB,  there  is  a  significant  improvement  in  the  system  identification  algorithm’s  ability  to  estimate 
the  open-loop  gain  accurately.  For  lower  values  of  SNR,  a  moving  window  with  a  larger  sample 
size  would  be  needed  to  obtain  more  accurate  results.  However,  as  shown  in  the  next  Section,  even 

with  poor  open-loop  gain  estimates,  when  adaptive  control  is  implemented,  tracking  performance 
is  restored. 
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K  Estimates  Using  the  MoMng  Window 


Figure  34.  Two  sigma  analysis  of  moving  window  estimates;  Ki=0.6,  cto  —  0  1108 dec /sec 
(T„  =  0.03  deg  and  SNR=37.277dB  ®  o.  luo  aeg  /  sec, 
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K  Estimation  Using  the  Sliding  Window  -  Smoothed  K  Shown 


Figure  39.  Loop  gain  estimate  with  upper  and  lower  bounds;  Ki=0.2,  aq  =  0.00739  deg  /  sec, 
cr«  =  0.00739  deg  and  SNR=60  dB 
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5.6  Indirect  Adaptive  Control 

The  loop  gain  estimates  are  now  used  on-line  to  correct  for  the  failure.  In  our  indirect  adaptive 
control  mechanization,  the  reciprocal  of  the  open-loop  gain  estimate  is  continuously  fed  back  into 
the  controller,  as  shown  in  Fig.  1.  By  doing  so,  the  failure  is  taken  into  account  and  it  is  to  be 
expected  that  the  control  system  will  respond  as  if  a  failure  never  happened.  Using  the  K  estimates 
obtained  under  the  same  low  SNR  conditions  as  in  Figs.  33  and  35,  the  post  failure  tracking 
performance  is  improved  -  see  e.g..  Figs.  40  and  41,  respectively. 


Loop  Gain  Adaptation  with  Moyng  Window  Implemented 


Figure  40.  Pitch  rate  tracking  with  failure  and  K  adaptation;  K=0.2,  ag  =  0.555  deg  /  sec, 
(Ja  =  0.03  deg  and  SNR=23 .29  dB 
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Loop  Gain  Adaptation  with  Mowng  Window  Implemented 


Figure  41 .  Pitch  rate  tracking  with  failure  and  K  adaptation  using  upper  and  lower  bounds;  Ki=0.2, 
cTg  =  0.555  deg  /  sec,  Ca  =  0.03  deg  and  SNR=23.29  dB 
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Figs.  42  and  43  demonstrate  this  point  for  an  extreme  degree  of  failure  of  Ki=0.2,  in  which 
case,  we  recall,  the  fixed  controllers  could  not  cause  the  system  output  to  track  the  reference  com¬ 
mand  properly  (see,  e.g.,  Fig.  17).  In  addition,  a  relatively  low  SNR  of  37.227  dB  is  used  in  this 
experiment.  Note,  that  in  Fig.  42,  the  estimate  is  significantly  worse  around  the  failure  point  than 


K  Estimation  Using  the  Sliding  Window 


Figure  42.  Open-loop  gain  estimation  using  a  moving  window  when  Ki=0.2  and  SNR=37.227  dB 

in  Fig.  3 1  when  the  degree  of  failure  was  Ki=0.6.  Thus,  the  degree  of  failure  directly  impacts  the 
loop  gain  estimation  performance  near  the  instant  of  failure.  Also,  the  peaks  in  estimation  error 
occur  near  the  peaks  of  the  input  signal. 

In  Figs.  14-18,  it  was  shown  that,  for  a  high  degree  of  failure,  the  tracking  performance  dete¬ 
riorates.  However,  the  K  estimation  error  peaks  are  smaller  when  there  is  a  reduction  in  tracking 
performance.  This  trend  is  evident  in  Figs.  33,  36  and  38  where  the  estimation  performance  af¬ 
ter  the  failure,  where  tracking  is  poor,  is  consistently  better  than  before  the  failure.  In  addition, 
the  higher  the  degree  of  failure  and  the  poorer  the  tracking  performance  provided  by  the  fixed  con¬ 
troller,  the  better  the  esitmation  performance.  Moreover,  Fig.  44  shows  the  loop  gain  estimates 
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after  the  adaptive  controller  is  implemented  and  tracking  performance  is  restored  after  the  failure. 
As  can  be  seen,  there  is  a  significant  reduction  in  estimation  performance  due  to  the  reduction  in 
excitation  when  tracking  is  restored  -  compare  Figs.  42  and  44.  Now,  even  though  there  are  nu¬ 
merous  instances  of  poor  estimation,  when  the  smoothed  and  bounded  loop  gain  estimate  K  is  used 
modify  the  controller,  the  ensuing  tracking  performance  of  the  adaptive  controller  is  excellent  as 
shown  in  Figs.  41,  43  and  45-47. 

Loop  Gain  Adaptation  with  Moving  Window  Implemented 


Figure  43.  Pitch  rate  response  comparison  with  and  without  K  adaptation;  Ki=0.2, 
(Tg  =  O.llOSdeg /  sec,  <7^  =  0.03 deg  and  SNR=37.227  dB 


The  adaptive  control  system’s  tracking  performance  at  the  higher  SNRs  of  40,  53.286  and  60 
dB  is  shown  in  Figs.  45-47. 
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K  Estimates  After  Loop  Gain  Adaptation 


Figure  44.  K  estimates  after  loop  gain  adaptation;  Ki=0.2,  cr^  =  0.1108  deg  /  sec,  a  a 
and  SNR=3  7.227  dB 
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In  conclusion:  Figs.  40, 41, 43  and  45-47  were  all  created  by  calculating  the  loop  gain  estimate 
over  each  time  epoch  following  which  the  reciprocal  of  the  loop  gain  is  fed  back,  as  shown  in  Figure 
1 .  In  addition,  a  and  q  are  also  estimated  for  each  epoch  bu  the  system  identification  algorithm 
and  are  then  fed  to  the  feedback  controller.  This  produces  the  q  output  signal  described  above  as 
‘q  with  adaptive  control’.  For  a  high  degree  of  failure  and  before  the  loop  gain  was  adapted,  the 
fixed  controllers  could  not  track  properly.  Once  an  adaptive  tracking  controller  is  implemented 
and  the  effective  loop  gain  is  restored,  tracking  performance  is  recovered.  In  addition,  when  the 
bound  limited  open-loop  gain  estimate  is  used  in  the  adaptive  control  algorithm,  the  hump  in  q  at 
t  =  4.5-f-  seconds  is  removed,  as  shown  in  Figs.  40-41. 

In  summary,  as  the  degree  of  failure  increased,  the  systems’  ability  to  track  the  command  input 
deteriorated.  When  the  degree  of  failure  was  low,  Ki  =  0.25,  tracking  performance  no  longer  was 
considered  acceptable.  The  system  identification  algorithm  was  applied  to  an  F- 16  class  control 
system  and  the  states  and  loop  gain  were  jointly  estimated.  To  improve  failure  detection  time,  a 
moving  window  algorithm  was  created  to  estimate  the  loop  gain.  The  loop  gain  estimates  fluctuated 
appreciable  from  their  true  value.  To  reduce  the  Auctions,  a  smoothing  filter  was  introduced.  The 
smoothed  loop  gain  estimates  were  then  applied  to  the  indirect  adaptive  controller  to  correct  the 
failure  in  the  system  and  make  the  tracking  response  appear  as  if  the  failure  never  happened.  The 
results  were  excellent. 
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Lxop  Gain  Adaptation  v«th  Moving  Window  Implemented 


Figure  45.  Pitch  rate  tracking  with  failure  and  K  adaptation  using  upper  and  lower  bounds;  Ki=0.2, 
aq  =  0.0739  deg  /  sec,  tra  =  0.0739  deg  and  SNR=40  dB 
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Loop  Gain  Adaptation  with  Moyng  Window  Implemented 
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Figure 46.  Pitch  rate  tracking  with  failure  and  K  adaptation;  Ki=0.2,  cr,  =  0.01108 deg/ 
(Tq  =  0.03  deg  and  SNR=53.286  dB 


Loop  Gain  Adaptation  vwth  Mowng  Window  Implemented 


Figure  47.  Pitch  rate  tracking  with  failure  and  K  adaptation  using  upper  and  lower  bounds;  Ki=0.2, 
CTq  =  0.00739  deg  /  sec,  =  0.00739  deg  and  SNR=60  dB 
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Chapter  6  -  Conclusions  and  Recommendations 


6.1  Summary 

Chapter  2  of  this  thesis  described  how  system  identification  techniques  can  determine  the 
unknown  parameters  of  a  model.  We  began  with  modeling  disturbances  and  the  importance  of 
not  over-modeling  an  unknown  system.  A  classical  system  identification  approach  for  solving  the 
unknown  parameters  of  an  n*^  order  SISO  system  was  given.  The  approach  was  then  demonstrated 
using  a  second  order  example.  The  example  assumed  there  was  an  absence  of  measurement  noise. 
When  determining  the  proper  model  of  the  dynamic  system,  the  applied  input  must  have  an  order 
equal  to  or  greater  than  the  number  of  unknown  parameters.  For  this  reason,  we  chose  n  sinusoidal 
test  functions.  Each  sinusoid  produces  2n  equations  needed  to  solve  the  unknown  parameters  of 
the  n^^  order  SISO  system.  Chapter  2  also  provided  the  case  when  measurement  noise  was  an 
influence  on  the  modeling  of  a  dynamic  system.  Because  of  the  measurement  noise,  a  stochastic 
approach  was  then  introduced,  defining  the  Least  Squares  algorithm.  It  was  then  shown  how  the 
strength  of  the  noise  can  be  represented  as  a  weighting  matrix,  R,  and  applied  to  the  state  estimates 
to  provide  more  accurate  results. 

Next,  Chapter  3  described  the  plant  used  in  this  thesis.  Only  the  deterministic  approach  was 
identified.  It  was  important  to  dismiss  the  process  and  measurement  noise  initially.  The  absence 
of  the  noise  allowed  us  to  see  the  true  response  of  the  system  and  determine  if  any  additional 
considerations  were  needed  regarding  the  model.  This  chapter  also  presented  the  methods  used  to 
augment  the  state  matrix  and  the  appropriate  control  laws  were  defined.  We  saw  that  the  tracking 
of  the  system  was  not  adequate.  To  compensate  for  the  steady  state  error,  both  a  PI  controller 
and  a  proportional  controller  were  described  and  implemented  to  represent  two  different  simulation 
scenarios. 
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In  summary,  a  system  identification  algorithm  was  developed  to  identify  a  systems’  loop  gain, 
K.  A  proof  of  this  theorem,  was  given  and  supporting  examples  discussed.  An  alternative  batch 
approach  to  loop  gain  estimation  was  also  given. 

The  recursive  system  identification  algorithm  was  described  in  Chapter  4.  The  algorithm 
used  Kalman  filtering  techniques  to  measure  and  estimate  the  state  outputs,  a  and  q  (angle  of  attack 
and  pitch  rate  respectively),  and  the  critical  loop  gain,  K.  We  then  assumed  that  our  measurement 
devices  were  not  perfect  and  noise  was  being  injected  into  the  a  and  q  channels.  The  Kalman  equa¬ 
tions  were  manipulated  so  that  the  loop  gain  can  be  estimated.  Once  the  identification  algorithm 
was  complete,  a  simple  example  was  provided  to  test  the  validity  of  Theorem  1,  the  system  identifi¬ 
cation  algorithm.  In  addition  to  the  recursive  identification  algorithm,  a  batch  estimation  algorithm 
was  also  provided  but  not  explored. 

Finally,  Chapter  5  confirmed  the  functionality  of  the  proposed  system  identification  algorithm. 
The  algorithm  is  tested  for  both  the  PI  controller  and  the  proportional  controller.  In  this  chapter 
the  expanding  horizon  Kalman  estimates  were  compared  to  the  estimates  from  the  moving  window. 
The  performance  of  both  methods  were  analyzed  and  compared  for  their  ability  to  predict  a  failure. 
Since  the  algorithm  is  a  function,  in  some  part,  of  the  measurement  noise,  the  SNR  was  varied  so 
the  effects  of  noise  on  the  system  could  be  analyzed.  When  the  moving  window  was  implemented, 
spots  of  poorer  estimation  were  observed.  To  help  correct  this,  a  smoothing  function  was  used  and 
tested  for  different  smoothing  percentages.  The  reciprocal  of  the  estimated  loop  gain  derived  from 
the  system  identification  algorithm  was  then  fed  back  recursively  to  provide  a  continuous  correction 
factor  to  the  failed  plant.  This  was  done  over  different  SNRs  and  failure  amounts. 
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6.2  Conclusion 


An  algorithm  for  the  identification  of  a  control  system’s  loop  gain,  K,  is  presented.  The  de¬ 
rived  algorithm  yields  joint  estimates  for  both  the  system’s  state  and  the  open-loop  gain.  The  open- 
loop  gain  and  state  estimation  algorithm  is  being  referred  to  as  the  system  identification  algorithm. 

Using  state  feedback,  the  original  unstable  plant  of  the  F- 1 6  class  aircraft  could  be  made  stable. 
A  PI  controller  or  a  proportional  gain  controller  needed  to  be  added  to  correct  the  steady  state  error 
of  the  pitch  rate  tracking.  The  final  plants’  tracking  performance  was  tested  using  various  failure 
amounts:  Ki  =  0.8,  0.6,  0.4,  0.2  and  0.1.  Tracking  performance  began  to  slightly  degrade  at  a 
degree  of  failure  Ki  =  0.6.  As  the  degree  of  failure  increased,  the  tracking  performance  decreased. 
When  the  loop  gain  Ki  =  0.25,  tracking  was  no  longer  acceptable.  Even  though  tracking  is  no 
longer  acceptable  at  Ki  =  0.25  the  plant  was  able  to  tolerate  a  failure  of  Ki  =  0.08  before  coming 
unstable  again.  Since  the  original  plant  was  robust,  it  didn’t  matter  much  which  controller  was 
used,  the  PI  or  the  proportional  gain  controllers.  Both  controllers,  when  implemented  and  ran, 
provided  near  identical  test  results.  For  this  simulation,  only  one  consistent  command  input  signal 
was  tested. 

It  was  also  shown  that  a  moving  window  can  provide  faster  detection  times  for  failure  than 
the  continuously  expanding  Kalman  filter.  The  moving  window  used  in  this  thesis  had  a  length 
of  thirty  samples  or  0.3  seconds.  The  initial  state  and  loop  gain  values,  a.  =  —1.4414  [deg], 
9  =  -2.4314  [deg/sec],  Ki  =  0.8,  and  the  variances,  0.1  [deg^],  1  [(deg/sec)^]  and  0.4,  were 
updated  before  each  run.  There  were  times  when  some  windows  provided  estimates  that  Jumped 
appreciably  from  their  expected  values.  This  occurred  around  the  high  dynamic  change  of  the 
input  signal,  when  the  input  wave  was  at  its  highest  or  lowest  peak.  When  the  window  size  was 
increased,  the  estimate  fluctuations  decreased.  However,  a  shorter  window  was  able  to  detect  a 
failure  faster  larger  window,  which  is  desirable. 
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To  reduce  the  size  of  the  fluctuations  without  increasing  the  window  length,  a  smoothing  filter 
was  used.  The  moving  window  reduced  the  fluctuations  but  also  increased  the  detection  time  of 
the  failure.  It  was  demonstrated  that  the  more  the  estimates  were  smoothed,  the  longer  it  took  to 
detect  the  failure  amount.  The  90  %  smoothed  estimates  still  detected  the  failure  faster  than  the 
continuously  expanding  Kalman  filter.  These  smoothed  estimates  were  used  for  the  rest  of  the 
simulation. 

With  the  moving  window  estimation  algorithm,  the  quality  and  accuracy  of  the  results  de¬ 
pended  greatly  on  the  quality  of  the  measurements.  This  is  a  result  of  the  short  amount  of  time 
used  to  calculate  the  estimates.  When  the  SNR  became  low,  signifying  more  noise  in  the  system, 
the  loop  gain  estimates  fluctuated  fi-om  the  true  failure  amount.  That  is,  there  was  a  higher  range 
of  values  for  the  loop  gain  estimates  when  the  SNR  was  low  than  when  it  was  higher.  This  devia¬ 
tion,  for  when  the  moving  window  was  implemented,  was  on  the  order  of  K  ±  0.35  before  the  onset 
of  failure  at  t  =  4.5  sec  and  a  SNR  =  37  dB.  In  contrast,  the  estimates  after  the  failure  fluctuated 
less  and  as  the  degree  of  failure  increased,  the  fluctuations  decreased  even  further.  This  was  con¬ 
tributed  to  the  additional  excitation  created  by  the  low  failure,  which  in  turn,  caused  poor  tracking. 
It  is  evident  that  excitation  of  the  plant  parameters  is  important  to  system  identification. 

All  the  research  so  far  was  to  test  the  stability  of  the  plant  and  the  accuracy  of  the  identification 
algorithm.  Once  the  system  identification  algorithm  calculated  the  loop  gain,  its  reciprocal  was  fed 
back  to  correct  the  failure.  The  results  are  excellent.  The  identification  algorithm  was  capable  of 
detecting  the  loop  gain  at  all  failure  amounts.  Even  when  the  plant  model  could  no  longer  track 
the  command  input,  the  algorithm  still  provided  accurate  estimates.  This  is  when  the  feedback  is 
most  critical.  It  was  shown  that  when  the  estimates  were  used  in  the  feedback  path  for  low  failures, 
when  the  system  no  longer  tracked,  the  result  was  nearly  complete  correction  of  the  failure. 
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However,  for  low  SNR  and  high  degree  of  failure  the  estimates  from  the  moving  window 
fluctuated  greatly  around  the  failure  point,  K  6,  causing  the  adaptive  controller  to  track  the 
command  input  improperly.  The  degree  of  failure  was  defined  as  being  within  the  range  of  1  and 
0,  1  for  no  failure  and  0  for  complete  loss  of  actuator  control.  The  moving  window  frequently 
estimated  the  loop  gain  as  falling  outside  these  bounds,  especially  before  the  point  of  failure.  To 
correct  this,  the  estimates  were  set  equal  to  the  respective  bound  that  the  estimate  broke.  When 
these  bounded  estimates  were  applied  to  the  adaptive  controller,  improved  tracking  could  be  seen. 
The  improvement  of  the  system  was  significant. 

In  summary,  the  loop  gain  of  a  dynamic  system  can  be  found  and  applied  to  an  indirect  adap¬ 
tive  controller  to  compensate  for  actuator  failure. 

6.3  Recommendations  for  Future  Research 

The  research  presented  used  only  a  single  input  signal  and  the  short  period  approximation  of 
an  F-16  class  aircraft.  The  algorithm  should  be  applied  to  the  full  scale  aircraft  system  equations. 
It  should  then  be  followed  up  using  various  input  signals  to  test  the  algorithm  at  different  levels  of 
excitation.  Also  one  can  create  a  scenario  when  the  B  matrix  is  changed  to  do  structural  damage. 

When  simulating  the  failure  of  the  elevator  control  surface,  no  process  noise  or  external  dis¬ 
turbance  is  injected  into  the  model.  Process  noise  and  a  disturbance  noise  should  be  added  into  the 
model.  A  constant  noise  vector  was  used.  Instead,  running  a  Monte  Carlo  run  to  obtain  a  random 
noise  vector  would  be  more  realistic.  Also,  instead  of  performing  a  single  error  run,  it  would  be 
better  to  show  mean  and  1  sigma  time  histories  for  10-25  Monte  Carlo  runs.  This  would  give  a 
greater  insight  on  how  the  adaptive  controller  is  performing. 

Most  of  the  simulation  was  done  non-real-time.  A  new  simulation  code  could  be  developed 
to  simulate  the  failure  real-time  and  correct  real-time. 
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Another  study  could  be  created  under  the  flight  condition  of  straight  and  level.  This  would 


require  using  a  dither  to  enhance  estimation. 
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